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m -A FAGM'ORJAI, STUDY OF .TI-r^:^v.RKLA'ri9NSHIPS BETWEEN > . 

^ • ' • ■ ' . . . '" , ' . > . > ■ 

TEACHER- HE fcD OBJECTIVES AND' STUDENT PERFORMANCE IN ^. 

^ '■ -UICSM HIGH SCHOOL MATHE^vlATICS ' ' ' 

Department of Education" ( ' I 

, University of Illinois, 1965 

. . ABSTRACT ' * ■ 

■ V . • ■ ■ - 

This study wa^ designed to investigate s-omc possible relationships between 
,teac}fbr - held objcctues and student performance that appeaT,ed in the samples 
6i test items of, tlje new UICSM high school matheiTia.tic s . Two test booklet^ 
were^made on the basib of the ftrst five chapters of High School Mathematics , 
Course 1 by M. Beberman and H E. Vaughan. They were given to ,the same 
Pekin Hi'gh School students m Illinois before and after the, contents of the test 
had been taught. For each item, mobt of which consisted of four sub'-items, , 
scores were obtained fp^r i>ach student both for ppe-t^sf and post-test adnrdnistra 
tionSj and the gams between the tu o \^ere cum^ted. The sampfe consisted of 

- . ■ ' ^ . . ^ ' ' • 

154 9th-grade students. The bamv te^st bookletsv N^ere sent to teachers'who were, 

cUrrejntly using tb<^^^>^t, ajad they were, asked to e vacate the suitability of, each 

item for use in achievement tests for their students. Their reactions were 
• • - ^ 

assurhed to be arf\ indirect indication of their objectives in'teaching the UICSM 
text/ The sample Consisted of ^05 teachers itx>m 70' different scho'ols in l9 



states . ' . ' " ' • ^ 



Int^r cor relations among the 64 items of the twQ te5ts wei'e computed for 



''eaah case of'student pr^-test^, post-tes^s, gains, and, teacher ratings. Each 

*>. « - - ' ' ' ' ' 

intercor relation matrix wab factor a^nalyzed by the principal component method . 

and three,^wo,- two, and five fa-fctors, respectively, wer.e extracted from these 

casek. For the case 9f stuc^ent pre -tests, the first priri'cipial factor indiccLted a 

^ general aptitude for learning mathematics. The se<: ond» principal factor was, in 

ERIC ' . ' ■ ^ ^. • • 



.part, related to position of the it^rms in^e tests, and the third was, leff unidenti- 
* » • . * ' 

J^ed. * . ' * * • ' 

For the case of student post-tests, \he first priji.cipaLr factor indicated a * 
general achievement in the contents of the given chapters. Xhe second principal 
factor was consi-der ed/as a deductive-inductive, factor. ' For s^udfent gains^ , 
no interesting interpr etatj[on of the factors was warranted. 

' . t ^ / < \ • ^ ; ^ : ' ' 

For, teacher ratings, ,the first principal factor was related to the general 
/ - - * * . I 

tend'ency of each teacher's ratings i.e., the teacher's general response set. \ 

Items asking ft>r under standyig of the basic m«.thematLcal concepts tended t9 

> * 
h^ve high coeffitieyntts- on this- factor. The ^second principal fa^tof* was related, 

in'pSrt, to a p-r^ference for c.onventional vs. new^Enathematiq.s items. ^ The 

third factor jA^as related to objectives somewhat irrelevant to the'text. Tl\e 

. * •* • ' 

fourth facfor was related to the objective of algebraic manipulation, and the 

fifth was left unidentified. 

By a canbnical type of analysis, thei/actors from teach^er ratings were 

mktched with those-fronri student performance for each of the three c^ses so tKat 

*' '. ~ t - .. 

the similarity between the two sets of factor coefficient^ was maximum. In 
this analysis, pairs, of highly ctongruent factors werg obtained both for Ihe 
pre-test and for the post-test cases. In the-c'ase of student gains, however, no 
"fafctor was significiritly congruent with, teacher ratings. Howe.ver, mean gain 
scores showed a positive relationship with mean, teacher ratings except for a 



few special it^^-ms. 



\ 



FOREWC^RD 



Workers in ciirritulum evaluation have become increasingly aware of the 

f^ct that some of the b<;bt efforts at curriculum reform. produce superior learning , 

only in the hands of a r^^lativeiy small group of teachers. Consequently, it would 

be of litfle use to-Jearn that ci^rric ulum X produced significantly better i^arn^ng 

in 50,000 randomly selected s.tudents than curriculum Z didin'50,000 com-, 

parable students under the tutelage of Z, 000. randomly assignc^d teachers — evCn 

♦ , . ' ' / ' - 

if such classically ideal information were available. ' . • * 

School System A should want the bdst curricularo for its owji teachers, 

who may not be .at all re.pressehta.tive of the 2, 000, or it may plan to hire (or 

tra^n) teachers who can teach much rnore'to its students than the average learned' 

by the 100,' OOO. Curriculum Z could easily be the best for System A, especiSilly 

if it slicqeeds in upgEafling its staff. Furthermore, hundreds'of scho'ol systems 

«* ' ' ' • ■ 

around the country may sa.tisfy our description of gystem A. 
• ^- ' ' * 

Curriculuiji evaluaWop for ambitious school's, 'then, needs to be carried out 

' ^/ , . . . ^ ^ 

relative to sonle characteristics of teachers related to the content of the programs 

bein^. evaluated. Many studies of general, teacher variables have beei^ carried' 

Out,, and in a Jqw pases, such variables have been shbwn relevant to piJpii accom- 

,plishm.ent in the new curricula . -^^ However, most m*easures of cla*ssroom be-, 
• g , - ' , ^ • • ' 

'ha-vior, personality, ^and training of teachers seem, a priori , .to have little rel^i- 
vance for use in evaluation of 'new curricula. This does not deny the value ol , • 
further s^tudies wiJih'generaHte^cher variables, but it'does Suggest that some' \. 
approaches to content oriented teach^ vairiables .sliould be developed. 
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Alpert, R., etaj., Psychologi^l factors in mithematics educMion, 5MSG.^ 
' ' News,ietter , i^pri'l, 1963, No.. 15, 17-Z4.'^ . ^ ' 

^ S^aulding, Robert L.> Achievement, Creativity, and Sfelf-Concept Correlates 
of ''Teache r-Pup^ -Transactions inj|f:iemefttary Schools^. Coop. .'Res. Pi^oj. 
No. 135?^, University Qf Illinois^ 1963. 



FOREWORD (Continued) - ' 



The UiCSM Ma-thematics Project has been* fortunate in having been able to 

' • ^^^^ ' ^ ' ^- ' * . ^ 

interest Dr, Ikeda in fhjs geri?ra^ problem. The .report which follows represents 

a preliminary exploration of teacher-held objectives fpr UICSM first year algebra 

classes and sorpe relations 'between these objectives and student achievement. 

This report, which was submitted as Dr. Ikecla's disserta^on, is mo.re detailed 

and mori tech^cap than most previous UICSM Research Reports. However, \ye 

have decicled \p issjue his thesis, in its entirety, ^as'a number in this series be- ♦ 

cause of the pbtential value we ^Se in Ikeda' s feohniques for othe.r- researchers 

interested in teacher-relative curriculum evaluation. v/^ ' * 



J , A, Easley, Jr , '4 
UICSM Research Coordinator 
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CHAPTER I • 
INTROBUCTIO"N 



This study was designe.d to investigate some possible relationships Jbetwe^n 
teacher-held objectives and Studemt achievement that appeared in responses to 
samjDle tests of the new IJI^SM high school mathematics. ' ^ ' 

^- More than thirteen years l^ave passed since^ the University orillinois Cc^n- 
mittee^on School Mathematics (UICSM) started to develop new high sichool mathe-' 

maticsr curricula. The unique ideas developed by UICSM on teaching modern 

. * * * * ^ '-i 

''^math^ematics at the high school level have been widely recognized, and a great 

number of schools^ aTe now offering courses based on this curriculum. 

To teach mathematics in the wa^ e'xpepcted by UICSM ^uthprs, 'however, 'ts not 
easy for teachers who we^e trained in^traditional or conventional ways, and s^ome- 
times tKe ideas involved iii the new curripulum arouse confusions and contrB- 

versies among high scho61 teachers. Although the UICSM provides a training pro- 

^ > - ^ * • ' * ^ . ' f ' ^ ' ^ 

. gram for high ^hooi teacher s, th^ pu?:ppse of this program is net always per- 

.fectly attained. It is reported by class-roo^ observ-ers that high scTiool teaehers 
^ trained in UICSM institutes teach m5:thematics in different ways," and not all of 



them teach the new curriculum as it should be'taught. The high school teachers 
have their own interpretations of and objectives for the new materials. Which are 
not necessarily conformable to what the UICSM really- intends. The importance 
of studying'what kinds of objectives the high school teachers actually have^-^s 
been often pointed out, sinte the success of teaching the new mathematics greatly 
depends on \Yhat the tea^chers t^ink of it and how they rearct to it. The study 

' ' • ^ " • ■ • ^ ^ if ' ' 

stifnula*tedNby this^kind of demand* A - 

Wh'en we refer to 'te^cher-hUd objectives' for mathematics*, it doe^^ot mean 
. that the objectives are always explicitly expresseti*or consciously rec^^raized by 
every teacher. Some of the objectives might t^e clear and could b#^^ifined by ex- 



^ ^ > «^ - / • 

- ' ' . ' ~ ^ • ' *> 

* ' .' . ' * ' ' ^ 

pli(.it words. Some of th*!^ o6jectives, how^yer/, 'might be unclear and vague and^ 

teachers rr\ight be/una,ble to express tJitm ii^MSforfnal statement^ '''Such objectives 

mijght pnly be expressed implicitly, and ev^n teachers themselves might not be 

* t X * * , • ^ V ^ « 

^ conscious o^he objectives they hoW! This implies that direct questions do not 

always uncovOsr Such hidden objeictives. Furthermore, researchers- themselves 
' *^ » • " * ' . 

' ' - 

do*notknow precisely what ki^ids o£,questions sh9uld be asked of the teachers. 

^9 ' ' ' : ' ' ^ . ' 

In this study i^acher-held objective^ Si^e exarAined in indirect wavs. Prior to 
the analysis, Vve did not assume any definite categories or structure of objectives 
♦ such as Bloom (1956) and Guilford (1956) have .suggested, nt)r any Rationale 
for the use^f objectives^ such as Mager h^s proposed. The objectives 

we were interested in were tho^^e^hat arise specifically from the Tnterac tions' of 
the^'new UIC^M'text and the teach-er S' who use iU ' ' ' ^ 

* .1, Teacher Judgments of Achievement Test Items 

• • - » ^ 1 « < 

"One approach taken in this study, is to examine the teachers' judgmients* of 
small groups of te^^t items, many of N^hich are purported to test the abilities 
students attained in a new rnatheraastics course. Some of the test items are les^ 
related IV> these abilities. Test it^rnsf. were- presented for- evaluation to high 

^school teachers who wer^ using the l^rtest edition of the.UICSM first course 
text. Most of the itefns were presented groups of four which dealt with the 

•^satne topic and had the' same form.,, Avfew items were presented individually. 



•The teachers were a^ked to judge the Suitability of each group oj[' test. items 'for 
<\xse in achievement tests in their own classes. In the rest* of this report theSe 



'groups of test items (usually consisting of four but sometimes single test items). 



sometimes single test items). 



are referred to as the 'Utems*' of the instruni^nts used.,. They are in fact items^ — - 

, - : y . ■ ' '■ : A 

on the teachers' questionnaire and are the smallest-urtits/of ^nalysj.s for the stu- 
de.nt, achievement tests, since responses to sub-items w^re not.afialyzed. 
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Teachers judgment's of such items are assumed to be consequence' of their ^d- 
jectives foi* the*,new^mathematic s 'course. / 

An aim of, the achievement tests is to measure the abilities that students, have 
^acquired during 'the study pf given part of the material. School teachers would 
teach tire subject ma\terials in their own way, as they believe best. After some ,^ 

* » *i \ y ' * ' > ' ' ' 

teaching ol^ix^i: material, the teacher s' would. be likely to know how much their stu- 
dents have progressed by their teaching. In the construction of achievement tests 
to measure the students' progress*, we assume they would be likely to prepare ^ 
test items that are closely related to what was stress-ed during their teaching. 

It is believed that, when bets of ready-made tebt items are presented to the * ,* 

' \ ^ ' ^ ' • 

teachers, they tend^ to exp'ress agreement or disagreement with them according 

to their own values in teaching the subject;. It would be reasonalbe, then, to as- 



sume that the teachers* reactions to the items are an indication of their objectives 
for teaching the 'subject. ' ^ /' 

• We aj^ not asking here for every detail of the objectives held by individual 
teachers. To study the case-by-case objectives in every detail is so complex 
.^that it is beyond the scope of the present study. In a rough' s-ense, however, ob-^ 
j.e<^tives held comixioYily by all of the teachers, or''at least, by some group of th^ 
teachers could be icientified. What we'are interested in are such common oU- 

jectives that appear 'among all, or some, groups of the teachers when the'y^.^iystl- * 

• \ ' ' ^ r 

uate samples of achievement test items. We are interested in what kinds of ob- 

jectives and how many ^Kfferent obj^tives, at the minimum, would be necessary 

y ' ' . ' , • - ' • ■ • ^ * ■ ^ 

to account for a se^ of teachers' reactions. 

^ This 'hption 'suggestSythe applicatipn of the factor ^alysis model developed 
in. the field pf psychome^i^ics. The^model of factor, analysis is useful-e s^gcially 
when the aim of rese^^^rch has a somewhat-exploratory nature. It has be^^widely 
applied to ,eduaationa]^and psychological researched. * It ha$ been used to invee- 



. tig^ate basic mental abilities, personality traits, social attitudes, and other human 

attributes underlying si^lb of educ ^itytonal arid psychological measures. Detailed 

rev^iew oi past studies by fae toi^^naly^sis is not the main purpose of this report. 

Some of these studies, however, , should at least be mentioned.. These include, 

for example; Thiirstone (1938), Thurstone and Thurstane (1^41j, French (1951), 

. * and Guilford (1956) -in the area of pnental abilities; Eysenck . ( 1 953), Guilford and 
, , • , > . • . - \ 

. *Zimme rrn^n (1956), and Cattell (1 957) in the -area of' per sonality^s^tudies j 
^Bpr^atta, Cottrell and Meyer * ( I 956) and Schuessler^^d^^Dr'iveV (195^ in the 
are^ of social psychology. ' ^ ^ • . ^ 

' ' ^ In a study closely related to our present one^L. R. Tucl<,er (^1962) a'rialysed 
^ the reldyance judgment ^,on the test it^m^ of '^Developed Abilities of the*«Social 
Studies, which were to be given to college applicantb. ZZ5 test questions were^ 
rated by .seventeen fexpexts, artd'two different kinds of vi^ew points were found by 

^^^he factcrr analysis of intercorrelations among the raters. The rate'Ts y'ere . 

grouped into tw-o differej/t ki;^ds. Group A was a group that emplhasized probl^rr^^ 
soIvingfaBility for both secondary school instruction ,^nd for e>;^Tnining students. 
Group B\w^s a group that emphasized the development of a/facility to organize, 
. material and to exp^r'ess genejklizecf conclusions effectively. 
W\ * J.. W. French (196Z) analysed the reader di saLgreement that app'eared in the 

scoring oi an essay type test.t, 'fifty-three participants consisting of Engli^sh . 

-• \ ' ■ ■■ • . • 

teachers, soiu-ial scientists, natural .scientists, write.rs, editors, lawyers, and 
- ^ buiine^s e^ecutiv es^i^^kd a.nd graded 300 college «fres4iman essays.. ,The iriter- 
^oi>relations of the gradecf -e/:of es amo/ig participants were factor analysed and 
six factor's were extracted, qIOI papers out of 300 received all nirre different 
grades, no paper received less thkn five different grades, and the 'average cor-^ 

rdl&tibn was only ^31. It wa^ 9bvi6us*that some raters were^^ressing one^ual- 

» , ' ' * * / . ' 

■ • • , • ' » * * / * 

^ ' ity and others stressing another;; ^ ' - . / ^ 

I 



• * - • , • . * \ ' 

Botft s^tfidies suggest to us that a 'factor analysis of teacher 'ratings of items 
may^ seVve as a useful model to* accoimt for the ^diffe^rent poirrts of view teachers' 
have on jlh^i\^en set of teaf items, \Part of the present stu^y consists of a, factor 
analysis of J:eacl)er ratings- of t.estltems^ alth^Kh we are not intere*sted in a' 
typology of teacher s 'as, w,ere the above mentioned sVud'ies.' Ouj: cqngern is 
rather with the' Structure of te^uanier jud^^e^ijts I'etativ^e ^o thQ ijten\£ themselves. 



Z. * Relationships'" Befeween'lieacher JadgmisntS' an^ J ' . <■ ^ * 

' '■ "'V'- ' >v.; • "^• ^ ;■ 

'* * * S.tudent 'P^er fprm^ance pn T^^st Itep\s * • • V J 

:n addition to irivestijgating teiach^r-Heid.^ijj'ectiv^s^ it, £s ^^a^Lso irnportcint to 
•see whetKer or not students vy;ho ^jr'e^study{ii'g thfe-^ICSM mat'eriais'de vi^fe 



, *^ilities alqng the lines Vhich -the UjtC^f^ autHors- .W.e cf6.ii'*t xeaHy kjio\Mv'* 

v/hat ;students learrv.fromt'the.pe^w^rrtathematies \cur^iGulum. ^More specifically^ ' 
we dpn t know wfe^t kinds of-abilfties ^^r e#»desGjrrbed-^hVa set ^jf/i t^etn^ "regres'ent- 




^ma tMfe pna tic s 'coarse. Such in^o.rmatioj;i/ even a;6 fehe *de\&c fitSt^ve '1^ wopld ^ . • • * 

be valuably- for th^ future developn\ent o^hew rnjfflh^matic s cuxciculs^ Thes^ 

* " ^ ^ •/' * •* * C J ^ » *. ♦ . 

.J. ' /• ^ , . • . • • ^ • ' *. • » > • . « ^ ^ 

s suggest the usefulne'ss/^f-a^ factor a])ia'lV tic -study* of tfi,e performance 

^ stade^nts, . . ■ • - ' - • 'i , vv ^ * 

. . - - * • * ^ 

♦ * Furtherrrior,ef, it would al'So\be va^uable^tcj discover if thene is any ^r elatibn'- 
» *♦ * • . * ' « * ^ i. . * , , ' ' ' * 
ship between tHe objectiv.es OlCSlvt teacher s' hol'd and -wha^iVlCSls^ studtent?* 

♦ * \ ^ * ' ' ^ * . ' ^ ' ' \, ^ ■ * . ^ ^ . . . ^ y 

l^arn. It would be especially inte^restingMf 'meaii« w^rn? i!vailable'*for* coIIcq ^ 



concerns 
.of 'UjlCSM 



data oh the objectives of a sample of teaeh^-ra^^d ^lso^X)n th^^chi^ vem'ent of 'the 

students of eagh of theri^/ H6w^ver, tHe administration of this type of s*tudy was. 

. • • ' • ' ^ ' , ' * ^ • / ' ^ ^ • ' ' • . ' • 

judged'to be .toO complex £o» existirig resources, ' Besides if seamed, wise«'to 

* invest the available resources in a more exploi*ator^y* type'of study. . ft is nec-r 



.^iS^^sdry to dibto\er som^ cnaracte^rlstic s of thv population'and the instrumerxjs 

' - ^ . . • 

before om-^cdh dt;sig»n \vith confidence a stud>/of casua^ relationships between 

teacher-hlld objective's and studeHt achievement. 

Nevertheiesb,, when we have test itt^^ms which a're' supposed to measure stu- 

. * ' ' ^ ' * / ' V . ' 

^dent abilitii^b on the^contents of text materials/ it would be very, inter e sting to 
«. . . » t . ♦ ^ * ' - < • 

toVripare information on the teatlj^ers' judgments pf th e test items with the actu al 

* * , . ' -. • * ' 

.student performance on the same item's. . .The 'information for^ student performance 

woufd be helpful for the inte^pre tatio.n of thc teachers' objectives found from the 
analysis ol thein ratings on items. AlbO the information fi^om the analysis of 
te:^cher tatingt on items would be helpful in the interpretation of the students \ 
achievement on the same iterr^s. » ' • ^ ^ 

* Many of the items provided in this btudy are purported to te.st tlie abilities 
lhat stu<^ents sliould attain in ,the UlCSM first? mathematics coarse, but some^ol 
the items are nal^^ -As we hav.e hypothesized in ^he earlier paragr^aphs, , it 

' * , .V/ / ^ ^ • • • ; ^ 

^teachers think the itemsWhich are 'Stressed in the course are important, then 
wc may expect stud(/ft;;^^ to perform best on these-^ite^ns. Moreover, the items 

r V . . . , ■'■ • , . ■ - 

uhich the teachers do^ nbt think is i*mportant should be on^s-on which students 

' * f / . • ' ' : 

perform less well — if there does yexist a r elatibiyship between them. This 

prSbTwn can be investigate^ by the analysis oi correlations between m,ean values 

•of teacj^er ratings and mean' values bf student performance.. • ' r . 

♦ On,the other nand, a factOr»analysis of the 'intercor relations of student v 
scores pn items^will tell us the students* common abilities which underlie a 
giv.en set of items,. ^ A factor analysis of the infercorrelations of teacher "ratings 
gives-US comniort factory for teacher r^objccti'V^s^ We are interested in knowing 
bpth of these structures, ^ore^oveir, if we tan develop a technique ' for investi- 
ga^ng! the .mutual r elatioiaship between Iwo sets of factorial structures obtained 

^frortt the same items, we could ask if there arc any consistent epattetns'betueen 



I 



... 4^' 

« 



the factory underlying teac hcrs^ratirigis on'test i'tcmb <ind tht 'i'a'Cf^rs underlying 

' ( 

r \ , - ' • . 

Students scores x^ii'tne same items, • ' ' . ' > ' 

In' past stu<i>es 6l factor analyses, Twas^n^ot able to iii^d an analysis of the 
mutual relationship b,etween factorial structures of such different performances 
\ on a set of items as we'hav^ in the case of tocher, ra^ngs and student perform-^ 
ance.^ It seeme^^Wlij^ssarv to exte'nd existing* technique s in oJider to carry out — 
such a stuply> An appropriate technique foi* analyzing the relationship between 

* factor struc tures^btained from entirely different populations is developed in 
the next chapter. ' ' " » 

' However, there ^re s'ome other technical problem^? which it is necQ,^^3ary 
to mention briefly. When we relate teacher judgnnents and stu-dent pe^rforrrlance, 
on a set of items, 'v. hat is the best ;neasure to describe student performance^ o 

* Since we cannot assume'that students tom'pletely lack the abilitie,^ that interest, 

, , ^ • J 

us'b^-fcrrtr4hey receive instruction, it seems r^ast appropriate to look at the ' ^ 

gain^ made between the administrations of items before instruction and aft.er 

instruction. Howe\er, there'are problems in interpreting gain scorefe, dis-. 

c^ussed in the next chapter, v^hich make it ^ad^i.sable to examine performance _ 

^ onpre-test and post- test adm^inistratiohs separately as well.as analyze the 



gai^s b^Ween them. Alsb some compromise s-eems required between the 
rfequiremenfsiof reliability of-rfn ilem score and* the necessity of m^easu.fing 

■i ^- : ■ ' ' ' ' , • ■ . 

ma^y different Objecti^ves within the spac6 of a^ngle. class. The compromise 
/ • ) • ' " 

'we Aave adopted is described in Chapter IIJ. - ' • - 

In this study, we shAll anal<rze the following: - 

..•/•• ; . ' - ■ 

*(1) mean*values of student performance on pre-test and post-test admin- 
istrations of items, as well as gains between them, in order to discovx^r on 

*j ' ' ' ■ ' ■ . • . > ■ ' 

whatlkinds of items student^ jierform b.es^; 



r 
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• . {ZY mean values of teachers' ratings in order to see-Wiat krnds of items 

teachers pr.efer; /'f* • ' 

f '\ . * 

(3) the rel^ionship betwe-en the mean values' obtained in (1) and (2) in 

order to see if there exists any relationship between teachers' general preferences 

and s tudenf performance; 

(4-) — a-iactoxi^l-struc ture of studexit perfoxmance to find theVni nimnm 



dimensions which account^for studenf abilities; 

'(5) a factorial structure of teacher ratings to find the minimum dimensions 

which account for individual differences in teachers' objectives; and finally 

. (6) • the relationship between the two sets of factorial structures in order to 

«* • 

' ' If ' ' " 

. determine whether there exist any consistent patterns between individual dif- 

"ferences in ratings by teachers and those in student abilities. 



V 



CH-IAPTER ir 



THEORY AND HYR'OTHESES 
1'. * St^ent Perfoirnance and Teacher Preference for Items 



In this chapter we shall use the generic term **test*''to refeT to any stimulus 

- -. • i ■ . 

rnaterial that generates a respo nse that can be scored onTSome psychologically 
interesting di-mrnsion. ; When a set of ability tests, small item groups, or even 

• ' / ' . * - t * 

individual test items (generically, a set of tests) is given to^a group oTstudents,' a 
facfi^^fe analysis of the intercorrelatipns between the test, scores would give'us in- 
formation concerning wfiat kinds ^oi basic abilities underlie the 'set of tests. Also, 
c^ learn the minimum num.ber of different kinds of abilitiej^phat have to be as 
sumed in order to account for the inter correlations between tests over the stu- 
depts. 'Suppose that, we have Test A having a numerical factor. with a coefficient 
(or factor loading) of 0.8 and a verbal factor with a coefficient of 0. 2. A stu- 
dent who has a high ability on the numieric^l factor and a low ability on »the vjerbal 
factor would be expected to have ar-higKer Score on Test A than a student whp, has 
a low ability on the numeric al^factor and a high ability on the verbal factor,, even 
if the two students Kave fhe same total on the two factor scores. 

On the other hand, .when the same set of ability tests is presQ,nted^to a group 
of teachers and the degree pf the goodness of each test is rated by them, the 
factor analysis of the ihterc'orre^ations between the tests would tell us whatj<^nds 
of, a/id the minimum number of, different view points conce^rning the goodneb^ 
of the tests that must tfe assumed to -underlie consistent differences in tfeacher 

preference in order to account for the inter correlations between the tests, bver 
/ • * I * * ' 

teachers. Let as suppose th^^t Test A has a high coefficient (or loading), on 
/ * 

Factor I, say 0.8, and a low co^efficient on Factor 'II, say 0.2. Under this' ' 

' 6 
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ciK:untistaince,' a te'§.cher Vho emphasizes f\icto.r .1 and doe's "not emphasize . 
Factor II. rriay be expected to, give a high rating score to Test A, On the o.thej;^ 
hand, '^a teacher who ernp^sizes Factor II and does noi jemphasize F^^:to,i:;^I may 
be expected' to give a relatively low rating score \o Test A. 

"r^hether these Factors I and II do or do not^have any relationship with the 

'numerical factor and the^verbal factor which have been found by the analy^sis of 

* ^ _ ^ . . , 

student scores raises a new -and interesting question to ask. If the teac.hers are 

capable of rating Te^€ A ^ood (or bad) for the reason that it Has a high numerical * 

'factor and a low verbal factor, and if they rate other tests in the same way, the ^ 

. . ^ ' . / * . - . 

f-aqtorial structure found in.the set of ^tydents ' si or e s. w.oiild have some similarity 

to the structure found in. the teachers' r%iing scores. If the teachers rate the 

tests without paying any attention, consciously or unconsciously^ to the ability 

factors which th^ tests are to measure, the factorial structure of the tests ob- 

tained Irpm the teachers' ratings would be different from that obtained from the 

students) performance, since, in such a case, the teachers must have rated dif- 

ferent aspects of* the tests/ One^ of the purposes of this study is to find wheth^' 

or not any correspondence epcists between two such structures obtained from 

actiieveme'nt tests* 



2. Post-test Achievement vs. Oalried Achievement 
The second problem arises from the question: **pb the .students ' performance 
scorejs on a ^et of achievement tests serve as the best measure to be related to the 
teacher^* rating scores?*' An aim/pf the achievement test is to measure the stu- 
dents* progress during the^study of the course, ^Achievement, ' therefore, does 
not mean a level of performance pn the task given at the end o£ the course, but 
it does mean an^amount of jSirogrfeds during^the course. ^In this sense, *a gain 



^ore of the^ performance ai. thte^'fend of th.e course from the performa^nce at ^he"^ 
beginning of the course ^vcjfuld a better measure- of achievement than the per- 



8 



focmance srmply shown at^thc end of the course. This requires us to give a pre- 
test and a post-test, and obtain a ga,in score frpjm th^m to be used as a nneasure 
of achievetnent of the students duriVig the course.' If we l ar> asS^ume-^6 special 
co'aiChi^ng on tl%e given test, we could use the same test twice .-r- as a pre-test on^ 
time a.nd a pdst-tesl the other. However, some careful direction \o trf^ ^students ^ 
Would be necessary at the pre^test time, becS.use they may be unfamiliar with the 
given" material and may becortie too frustr ated^and discouraged to attetnpt the 
items. , ^ * 

As for the te'st, a hi-gh average gain score between pre- and post-tes-ts is 
an indication that the tests are mea^suring well the students* achievement attained' 
in the course. ' A low gain bcofe may come froi^ several sources.' Some tests 
might be too difficult for students both on pre- and post-tests. If a test is such 
that its content is not stress^ in the course, the gain* scor'es might be low. ,Also 
some tes*ts nfiight be so eafey that the students do well .at both times, and con^- 
sequently 'the gain scores might be low. The students knight hav;e alrea^dy known 
*the-content of^the tests, or hott^e tests might be correctly answered without any 
knowledge learned in tbe course. In otnei*^ases, .th^ content of the tesjLS^might be 
irrelevant to what the studeiits studied in the cplirbe. The ga^n storey would, be ^ 
low ^also, eve,n though the difficulty of the tests is moderate at both times. In any ^ 
case; a low g.ain score^ on a tisSt indicates that it does not. serve as a good achieve-^ 
ment test. N^ven though most students do welf at the end of the coui-se, thi^^does 
not necessarily mean either that the tests are goo^ or that the teacjier *s te^chir\g' 
was effective, unless the a^ejrage gain score is high. Practically, a test having' 
a low pr^-test score and a high post-test score tends to be a good achievement 
test in this sense. » y , 



J 



X 



In the previous section, we cjiscussed the problem of looking for the factorial 
structure of student performance in the post- tesl,, the factorial structure of teach- 
. er judgment, and^the r ei^^tionship between the fwo structures. The same d;LS- 
/cussion is possible, replacing the post-test performance of^the students by th^ b 



gain scored. Do teachers j"udge the t^st haying a high gain score to be good? 
I^/here any relationshij^ between the. teachers' judgrxients *gTid the gaiifi scor'es?- 
'To look for the relationship, if iny, betv^een the factorial structure of the gaiti 
\ scores and that of th^ teachers' rating scores is thus* the seCo;nd and maiai^ purpose 
of this study. However, separate factor analysed wene pl-anned'for the pre-test 
data, pdst-test data, and gain scores data in order to^void problems resultant 
from overlapping specific factors in the pre-test and-pbst- test data. ~' 

- Gulliksen's remarks on- ^intrinsic vaildity' axe appropriate here, since our 

^ \ ' ^' - • ' ^ ^ ^ ' , ' 

attempt^is quite parallel to what he suggested. 

* * * •« ' 

.... It would be my hope then that the future develop- ' 
ment of aptitude' a/nd achievement testing will be in the ' ? ^ . 

directions of greater emphasi-s on a search for validities \ ^ , ^ 
that may be fundamental and lasting as' contrasted with 
, those t]ia^ are likely to be fortuitous 6r transient. It seems' 
.that- this concept mrg.ht be denoted by the term 'intrinsib 
validity^ — intrinsic content validity for achievement tests 

and intrinsic correlational .-validity for aptitvi4e tests ' <. y 

far as Lean s'ee, we have in the achievement testing 
field the jucigm"ei|| of the^experts to rely upon, but we c^n do ^ 
^ much better and more intensive jobs of checking these expert 

judgments. If judgrnents a're, obtained fru^m a number of per- ^ 
/ ,sons, the technique s^of fstctor analysis can give some idea of 

the complexity of the system with whit-h the experts ate real- * 
. ^ . ly dealing. Furthermore, a more intensive use of pre- 

training and post- training tests woffM plrobably be of very ^ 
great value in sharpening the judgments of the experts f e- 
garding the relationships among dirferent types of content ' K 
(Gulliksen (1950; p. 516)), ' ' . 



3. A Mathematical Model Relating, Two Factorial Structures 

The investigation of a mathematical rela.tionship'' between two factorial str^c- 

> 

ture.s belo^ngs to a br*anch of canonicaranalysis. The applicability of canonical^ 

analysis to the field of educational research was fii^st proposed^by Hotelling in 

^iS *'The*most predictable criterion (I9i5). Since then* s^everal others have 

, supported the. applicability of this approach (e.g. , Thomso'n (1947)^ Burt (1948), 

* ^ ^ . f 

Bartlett (1948), Hor^t ( i 9^1 ), ^fetc . ) ^ * 

In 1948 M. SJ^ Bartlett proposed a" concept of internal and external factor 
analysis. To take his example, suppose tha4: a set of mental tests and a* set of.. 



physical measurements kiC-e made on the same group of persons. .The internal, .^^^ 



analysis of the menftal scores will yield tlie Ordinary factor analysis, and als^o 

the interna^ analysis of the phy'sic-al measurements will yield a factor analysis 

•of physicals-structure. The mutual relations (if any)' of the two groups of meas- 

urernents would' be examined means of an external factor analysis. ^^afrtf§£Vs 

method of external factor a'nalysis is a technique for matching' the underlying 

factors for two sets 6f.variated, the' mental scores and, the physical measures! 

The factor matrices for both sets of ya^riales are^ siraultane'ously related by 

• • \ . 

orthogonal transformations- until a factor /rom one ^t is maximally correlated 
with a factor from the ojmei* set, -ide.ntifying the first factor pair. These factors 

: * • ■ • 

are held fixed while the second^pair is identifiecj., and so forth. ~| 

\ As for the s^tability of factors over different batteries of tests, L. R. 
Tuck^er , developed **an inter-battery method^of factor /analysis jl958). Given 
twq tesj: , batteries, postulated^ to depend^on the same cpmmon fabfbrs,. l5ut riot 
parallel tests, 'factors that are common to the two batteries are determined frdm 
the correlations of the te^ts in one battery with the test in the other l^att'ery. 
Gibson (1940a, I960b^j96l) als© expanded Tackejr ,s method. 

-Both Bartlett's and Tucker*s md^thods- ar^*' closely jrelated to ou-r problemJ^ 
as far as the mathematical technique is concerned. , But they are different from 
our problem in the respect that the former rrtodels tTcat'thc case in Whicli the 
same subjects take. differentUests or the same tests in differ eF?it conditions, w.hile^ 

th%latter has to^treat the S:ase in which different subjects f^espond to the^ same 

* ' " ^ ; • " ^ ^ » .\ " ' ^ * 

tests in different ways. ^Tfiis ty^ ^odf *pr oblem^ has been treated in the context* , % 

of factoristl inv^iance iff which how much a factorial- struc tyi^e. fpund in one stuay^ 
is^jw^iriant ^oV anoti^ystudy is being'^inves treated, '^he'sfudies hy Tucker 
(I95ir! >Leyden (1 953)(fo§'ar\pw and Bui^t (1954),' Zacftert and Friedman (f953), - 
WriglJ^ and Neuhaus (1*955), tMere^ith (1964a, 1964]^ and Pinneau A^d New- 
"house Tl964) are examples in this line. ". 



The general idea which-w*e will use in this study is the fallowing. Suppose 



* that n items are givfen to students t# wcfrk, and le;t the standard score of the 
i-l-th ^student for the j-th item b.e zf. . * Th^ score, z.. , is assumed to be det^r 
^ined by a composite of several basic abilities, so-ca^ed, fa*ctors. If -'mg is the 
number of the basic factors which are commonly involved in more than one. item, 
z.. is expressed by\an equation ^ ' 

z.. =a,x,. +a.^x^. •f,..ia» x - ^fu. 

Jig Jig Iglg J 2 g_ _ 2 g 1 g." ^ JHlg n^glg' Jig 

' . ^ • • ' ' ^' 

The coefficients a , , a : , . . , a express the contribution of item^j 

' ■' -'^s J^s - ■j^'s ■ ■ • \, . 

to e^ch^of the f^ictor^ 1^,, Z^-, . . , m^, respectively. They are often called 

the common factor coefficients or the common factor loadings. In tliis study, we 

i * 

sh&U use the term 'factor oclficients' instead of * fac tor ^loadings \ the co- 
efficient a i§ large and other CoefficientSs.^£eappr oximately zero, one corii- 
men factor 1^. is dominant on the ite'rn j. The coefficients are invariant over 

the students, it* the item. is- sp'ecified, since they arc item attributes. 

- . \ . ... ^ ' . • 

' The variables;-^^.'V 5 • *^ * x refer to the amount of each basic 

ability that^tft.er'stu^eW i^.'''has,» anci they are often called theTfactor scores of the 

..^Jtudent ic-. fi is great, the student i^^ i s 'consi deiredf to .have hieh ability 

in the factor *lg. *TJ:\e factor scores are invariant over the given set of items, 

if the student is -specified, since th?y are student attributes, x's are assumed 

. fo be s^trldardizfed so that the mean item is* 0 and the standard deviation is-l'. 



The' term u./ 'is a function .of 'the item and the student. It varies for each 
item and student and it i.s called the uniqueness^of student for item j. 

similar model holds^ for the teacher ratings. If we let the rating of' 



f teacher i^ on the item j be z.. , tliG z./ is assumed to be a composite of 
several bas;kr^bjec tives held by the- teacher a;.nd it is expressed by ^n equation 



z\. = a.* x. . +4a.- x' . +a. x . -fu.. 



. (i^ =.l^, 2^,* . ; j, = Zf^. . 'n) ' \ 12 



where a,. , a, , .... are the commoo factor coefficients for the item 



j and X, : , . ,* • . , X 



are the common factor scores of the teacher 
The u.\ is the uniqueness of the rating of teacher i on the item j. z*s 
an4^*s are also standard scores.^;- 
4 Factgr analysis is a method for obtaining t4ie common factor coefficients'for 

each item ^nd sometimes to 'estimate the common factor scores for €ach person 
^ under some additional assun}ptions . - > ■ 

"^However, the coefficients a^p a^^, . a^^ are ncJ^uniquely determined 
mathematically. It depends on how the refemrice axes are taken, and they are 
taken by somewhat arbitrary criteria. This i s , r so-called, a rotation problem. 
^ For example," if an observed score of th^'^pcrsqn i on the item j is 1.5 and 
the number of common fac^tors is tv.o, both solutions below satisfy tlie equation 
of the model., ^ * ' • 

z.. = a , X,. + a ^ Xt u . ( 

1.5^ {.7){1.0) i {. 1)(1.0) r«.7 ' ' * . 

1.5/- {.5){1.6)>4 5)(0.0) f .7 : ^ ' ^ 

There are an indeffnite number ot solutions that sa'tisfy this condition. 

Or/c of tFfe criteria which'is most commOnly ubcd is the principle of ^'bimple 
^ structure. If only one*<:omrti3an^ factor is involvcdm an item, it is said that the 
complexity is one. If more than two factars are involved ih an item,- it is aaid 
that the complexity is two, three, four, ^ and so on, ^according to the number of 



common factors inv^olved. It is obvious that mihirnum complexity would be^^j^/- 
si^able for the description t)f the variable. 'The principle of simple structure is 
^ -a^riteri'cfti of minimum complexity of the factors for eacl^ item.''*J«* 

In the interpretation of the factor structure of teacher ratings, we must keepUn 
mind tli^effects of discarding the mean ratings. A consequence of factor anal- 
ysis "of inter cor relations -i^that ail factors obtained are dimensions of. individual 
differences. In this model for teacher jfatings, over-all a'greements in ratings' 
are discarded. * , • , * . ' .* 

\ ' ' : • • 

This, is not .the xigarqus statement df the principle of -simple structure. De- 
tail's may be found in Thurstone (1947, p. '335^.' ^ ^ '"^ ' 



The oJ;hcr princicde would be to take the refcr-ence axes so that the conSrir 

^bution o£ the first fayfor over all the items (tfie sum a,, + a-,, + . . . + a ,) is 

• 1121 nr 

maximum, and that 6£ the second factoids' (the sum. a: ; + a^ ^ + . , . + a -»)'is the-^ 

i Z , ZZ nZ 

next maximum, and so on: ^This is so-called the principal- axes solution. • 

These methods are, however,, the methods for rotatiilg axes within a single 

set of items over o,nC group of subject's? What we are consictcijing hp're,is"the 

deter mi jriatioji of axes bo as to take account of two sets of items aver different 

groups of subjects, simulrtalneously . <. ' ' , , * 

U ^ * . - 

Suppose that we Jiave taken »bommon factors from student scores for 

n dtems and m^ common factors from teacher ratings for the same n item§. 

The m^ and m^ ar,e aot'n^c t^ssarily equal. Instead of taking the sum of squa,res 

' '* - ^ 

of the first factor coefficients o\er n items to bo maximum for each group of 
data, ^s the principal-axes, rri(*thod does, we Ipj^/ld |,ake the first reference axis, 
so that the first factlS^r" coefficients of. n itexns for the student data are as similS^r 
a.s possible to the first factor coefficients of the same n- items for the teacher 

ratings on the basis of the criterion ^f similarity — the coef^ci^nt of congru- 

' ' > * 

ence which will be .explained later . The second reference axis also could be 
taken so that the second factor LOeffiuients of n items fof* the student data are as 

y' : ' ' \ ' " " ' ■ - 

similar as possible to the second factor coefficients ofv^the sartie n items for the 

teacher ratings, under tho additional conditian that the second factor coefficients 
.are orthogonal to t^e first one. This process could be continued until the pairs of 

fac^r coefficients ar^Q no long'e-3^^rr\ilar to each other. The system of matched 
:^factors obtained yn this way will be cpjasidered to be congruent factors. The 

first factor obtained, from the student sc ores is maximumly congruent witli the 
first factor obtained from the tc?acher ratfngs. > The seQoftd factor obtained from 

the stu'dent scores is the next ma^i^umly ccHigiuient with the secofid factor 

tained from the teacher ^ratings, and so forth. ' ' . 



The degree of congruence will bQ defined as the sum of cros s-pr odu^s of 

the matched unii factbr^oefficien^, where the unit factor coefficients refer to 

the normalized factor coefficients over n .items so that the sum of the squared 

©efficients is uhity,. THis degree of congruence ^ill be called the * 'coefficient 

of congruence**. The Coefficient of congT^uence roughly resembles a coefficient 
' \ * " • • • • 

of correlation, but it is not exactly the same, becaus^ the coefficient of congru- 

ence refers to the sum of crosfc-products pf the unit variables, while the co- 

efficient of correlation*refer s to th^ sum of cross-products of the deviations from 

the me^ns with unit variances. TJie coefficient of congr uen<ce "varie s between -1 

and +1. +1 means that the two matched unit factor coefficients are identical 

witH each other, —1 mearis that they are identical in the ^pgpsite direction, 

and 0 aneans "that they 'are Unrelated. ^ 

'Defining a mininltim coefficient of congruence, below which the pai/s of 

factors are hot considered jto be congru.ent any more, we could ol^tain r sets of 

pairs -of. congruent factprs. TKe^t if'-^isually le-ssL than eithejr m^ or mrp. The^ 

1 " \ . ' 

rest of the student factors (m„ - r of them) are considered the factors th'^t are . 

■ • • ' . • • ' ' ■ f 

involved in the student scores oijiy and non-congruent with the factprs for- teacher- 
ratings. The rest oi the teaLcher factors (m^ - f of them)' are considered the 
factor,s involved in the teacher ratings only and non-congruent with the factors 
for'the student scpr^s,, « ; ^ ♦ 

What we ar^ going fo.do in this study is to find the congfuent^ factor s (if^auy) 
invo^lved in both student performance and feacher ratings for a given set of it^rtns. 
If any congruent factors "are found) the .degree of congruence will be studied. 
Three kinds of data for student performance will be used. The first one is the 
scores, of item^on'the pre-test administrations, when the contents of the' items 
had not been taught. The- secon^-^ne is the scores of items on the postj-test ^ 
administrations after the, contents of the items had be^n^aught. 'The lafet kind of 
data is the student gains from pre-test to post-test on each item. Factors ' 



fcmnd from each set of 'student data will be matched with the factors found from 
the teacher^ ratings and the' degrees of co'ngruence for e^h case will be com- 
pared. ' • - * " * I ' * • 

'the rest of'this chapter will be used for more technical development of the 
computational procedure for getting'congr uent factors. Its rriain idea is borrowed 
from Tucker .(1951) anjl Wf igley^and Neuhaus (1955)., 



A Mathematical Rationale/or Matching TV^o'^Sets of Factors 



Now, let 



z/. 



T 



2 1 ^9 



J = 1, ^, 




and 



^^s s 



IN. 



Jig •^•v 



:ni, 



j = 1.' 2, 



= 1 ' 2- 



where n is tHe number of test items used, > 

, N,^ is the number of teachers who judged the items, an'd \. 
Ng is the nurnber of students v/ho took'the tests. 



(2) 



is an n X N^matrix, whose (j, i^) element is a standard rating of the 
jQth item judged by the i^-th teacher . , 

Zg j.s an n X Ng matrix whose (j, ig) element is a standard^scor e of the j-th 
item obtained by the ig-tti student. . ' - ' ' * . - ' 



2 . 
f 



:Dir 



3^ 



\ , ■ • . ■■ ■ " ■ ' ■ ■ ■ . , 

'When-we gire talking of a gain score of post-test from ,pre'-test, z_ would 
be the g,ain score of the j-th item of fKe i^'^h student. When we ere talking of 
a performance score of the post- test only, the 7,,.. v/6uld be thfe performance 
score of the j-th po'st-test' item of »thie ig-tii student, an^ so on* As -there is 
no difference between the kii^s of student scores in the mathematical formulation, ^ 
we* shall not' differentiate these -scores in- the following discussion unless the dif- 
f.erente has a special significance. * . • *' ' • 

* Por^matrices and Zg, the it^ms bearing, the samje row number j rep- 

resent identical items, but the difference is that the one is given to the' teacher s ^ 
to judge afid the other is given, to ^the students to work. - . * ^ ' 

For each row of the matrices Z^ and Z^,, the scores of tochers 'and stu- 
dents are assumed to b^ standardized,, for convenience, i. e. , 

i,^ = 1 • ^ 



= 0 ' ' • ' ' . (4) 



1 

Z ^ji J 
V i^ = 1 



- 1 . . . • (5) 



= 1 . . ." •• (6) 



Hence, -the products of Z and its transpose Z' divided by N yields a matrix 
of c'orrelationfcoefficients between items judged by teachers, ^ 

• • ^. , = n:j.^t^t • • (7) . • • • 

Similarly, , . - - 

■> . . " S^S ., • (8) . 



y : 
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'which is a^matrix of coTrelk,tion coefficients between items of tpsts for students. 

Both and Rg are nX n symmetric^ matrices whose, diagonal elements stand 

for a unit variance of each item. ^' ? ^ 

According tp the ordinary model of factor analysis, eac^i of the rViatrices 
' and is a|sum,ed to be factorized as * ^ 

♦ ^ . ' '' « ■'' ' 

and Zg^. A3X3 + U3 ^' • ' - (10) ^ ■ 



or Z^ and Zg are approximated by 

and . Zg = Z3 - Ag'Xg . - . , ' (12)\ 

A\p is an h X m^. matrix (m^ < n) which may be called a factor coefficient 
matrix or^ simply a facflor matrix for teacher judgments aft items. X^^ is an 

' m^ X rCl mWtrix (m^ • N') which is 'called a factor^score matrix for teacher 
X * T 1 • . T • 1 * 

judgments on it^H=ns. Ag and Xg are n X mg (mg < n)^ and nig X Ng (m^ < iNg) 
matrices for student scores, art^ called a factor coefficient rrtatrix and a factor 
score matrix, respectively. Neither m^ nor mg ,are greater than .the number 
of items n which is not greater than either or Ng, but is no? necessarily 

^e'^ual to mg.^Since trie"analy§is of Z'^ and Zg ca^ be ddnej^n parallel, we shali 
simply^ refer to Z, A, X,^ arid N, ' f or awhile, instead of differentiating • 
and Zg , A^ ^nd Ag , X^ and Xg , and Ug , ^ and "Ng , etc. 

, A and X codld Be determined ill various ways (see^hur stone, 1947 and 
^^^.HSrman, I960.)n One way is such that the distance between Z and 'AX with a 
lower rank than that of Z vs minimized in^'^a least squares sense, as in tJhe d^vel- 
opme'nt by Eckart and Young ('1936). (S^ also Hor^t, .L963). U could 'be re- 
garded as an errbr part of the appr oximatton.^'* V * ' ' 



The choice of using the Eckart and Young development corresponds to deter- 
• • mination of principal'axes factors from the -correlation matrix with unities 

in the diagonal ceils rather .than communalities in these diagonal cells. Recent 
-Work by Tucker (1965) using Simulj?.ted correlation matrices indicates that 
principa;l axes factoring of these correlation (^^pntinued to the next page) 



..... • A ^ * 

According to Eckart and Young, .a matri^f Z is constructed to the desiip^d^* 

d^^g^ree of .approximation in a form . ^ . , 

\'j ' ^ = FLX ^ ' (13) 

where"'F is-an-^^-X k brtht^normal matrix such that 



. • , ' ^'^' = H-' ' • ^^^^ 

. which i^ an ide'nlity matrix of order k-. . " ) 

L is a k X k diagonal matrix whose diagonal elements are positive. and ar- 
ranged in descending ordex -of magnitude, and ** 
X is a k X N orthc^gonal matrix such'that 

• . . F^x' =\ •'• : <'^' 

■ - If welet • / . • ■ - 



^ yequation (13) becbmes. 



A = FL ^, ' (16) 



Z = AX . ' ^(17) 



In our j3resent model, we could siart from the intercorr^lation matrix 

. ' " ^zz' ; . ^ (18) 

The components F, L, and .X in equation .( 1 3) could be determined from the 
latent roots and vectors o£ the int#rcor,relation/matrix, R, Since R is a square^, 
symmetric matrix with unit diagonal elementjs, R may be directly analysed by 
the ordina^ry principal component analysis (see Hotelling, 1V33, and Harman, 
1960). • ^ • . . ' 

Let^R be approximated by / ^ ^ ' • 

i- . ■ (.19) ■■ 



matrices with unities in the diagonal yields factor solutions closer to input 
cojTirnon /actors than does factor ^analysis p£ the&e matrices with- communality 
estimates in the diagonal eells. . , ' 



From (13), 



•0 



R.= i.(FLX)(EI,X)' 
^ i-(FLXX'L'F') 



« 

r 



19' 



(20) 



Since ^XX' = I and L = L' , tKen ' 



A, 

R- = FJL'-F' 



(Zl). • 



WjC should notice that, is identical' with patent roots of r,^and F is a set 

• ^ , ' . . % ' ^ 

of tinit latent vectors asspciated with L^, This could be verified by post- 

muKiplying both sides o? (Zl) by / • ' . ' 



A 



RF = FL^F'F = FL^ . 



(22) 



A 



The product of the matrix R and by eacl^of the column vectors of F is a vector 
which,is proportional to-that Column vector of F. In eacl^ resulting -column vector, 
the constant of proportionality is the corresponding elerffent of the 'diagonal of L^, 

This means that F is a seV of latent vectors of R associated with k l^rtent, root^s • 

^ ^ ^ A , 

Furthe rjnore, sinc'e k* latent roots of R are the, first k large.st roots of R 



e groporti'o; 
:losely .t^^: 



A " 7 

matrix R (= FL^F') with rank k (k < n) approxi- 



(riarman, I960), the groporti'on of the sum of the diagonal elements of L- to those 
of R indicates how c] 
mates the matrix- R. 
, Since A = 



. (16), equation (21) yields 
^ = AA' . 



Since F'F = I by (14) and L is a diagonal nnatrix, 

A'A-=L'F'FL 



(33) 



= L,2 



(24) 



Equations (Z3) and (24) als'o indicate innportant properties of'matrix A. • 

Let us go^back to our problem* Here we have Jtwa sets of data, the one is fr< 
3. group of teachers and the other is from a group of students* They are .expressed 



rom 



ERLC 



3o 



T ~ "^.^T " 



"^T ' 



and 
wh.ere 



A 



(25) 
(26) 



jPt 



a 1 a -, 



nrtir 



(27r, 



[:•■ 



and 



1 2 



^11 '^12 
^^S S 



^ a 



1(28) 



a , . a , 
nl-g nZg 



nm. 



(29) 



(30) 



(j = 1, 2, . , n ; qg ^ Ig, 2g, , , nig), 

-/ * 
- The elements of i;natrice^ ("28) and (30) represent column vectors obtained 

by partitioning (27) ajid (29) for each^cqlumn, respectivelyJ 

■ . ' ' ' "\ ' , • 

^ Now the question^ how^similar are the t^o factor matrices A^^, and to 
- * • Ik " - . * * 

each other. If^the first factor from the teachers' data is similar to tlie first^ 
factor 'from the students*, the vector a? iris approximately equal to the vector 
u ^ a, . If the second factor fYom the teac-hers* datk is similar to the second factor 

5 : - ; ' • ■ 

f^om the students', the vector a^ is approximately equal to the vector -a^*-* ^ 



J ^forth. 



•As a matter of fact, the coordinates in factor space are chosen in somewhat 
arbitrary way. *Hence, a transformed matrix ' 



(31) 



also gives us a^factor matri:fc hgtying differenj coordinated. *is a txansfojr- 

mation matrix^ S/mflarly, we could have a transformed matrix 



(32) 



for students data. Our problem is to choose factor matrices Brx, and B^* so 

/ . - ' . < * ' 

that the sinyilarity between two factor matrices is jnaximized by setting adequate 

cbpirdiiiatfiss . ^ ^ > ^ 

• First of all, an index express the degree of similarity betwaen^two factor 

matrices has to be determined. When two factor matrices are given by (27) and 

(29),/ the degtee of similarity of a factor Prj, in matrix (27) and a factor qg 

in matrix (29) could be defined by 



'n 



S a\ a. 



Pt^s 




a'=^. 



n . 



j=i j=i 



m^ 



m. 



(33) 



Using the vector, notations of (28) , and 



(a' a„ ) 



Pt^s 



If we express aH the h^ 's a|a matrix form, 

•Pt^s ^ 



/ 

(34) ^ 



H, 



TS 



D Ag Dg 5 



where the elements of H_>, .are h 

TS p„q 



(35) 



is a' diagonal matrix whose diagonal elements 
are eqiial to thef diagonals of A;^A^, and 

Dg is als.o a diagonal hiatrix! whose diagonal ele- 
ments_are equal to the diagonals of A~A„. 



S' S' 



*If the column of factor matrix and the column of factor matrix 
Ag are identical with each other, ' 

- ; -h = 1 . * ' • , ' (36) 

If the two columns are' orthogonal, . ' 



, , h^_ = 0 .• ^ . ■ • (37) 



h ' varies from -1 to' +1/ " • f 

* Such a measure of the deereei^of similarity is the same as Burt^s "unadjusted 

- . - 

correlation (lg48)", Tucker's '^'coefficient of congruence ( 1951) , " ancf WriglSy 
and Neuhaus's "degree of factor similarity (1955)'\ \[ ' 

Now, the coefficient of congruence, which we shall use in this study, between 
two factor matrices (= A^T^) and Bg(= AgTg) in ^quat>ons-,( 31) and (2>Z) 
can be maximized by choosing adequate transformation matrices as follows* 'By 
defining a congruent space betweei\ two'factor spaces and Bg, the first 

factor of B^ isrma*tche<l with the first facto^ of Bg so that the highest coefficient 
of coi^^ruence is obtained. The^ second factor of B^ is also matched v^ith the 
secondrfactor- of B^,. with the ^second highest degree of congVuence h*olding the 
orthogonality to the preceding factors, and so forth, until a significant degre'e of 
congruence can hot be obtained any more,- Generally, the nrtmber of congruent 
factors are less than the number of either factors of A,p or of *Ag.. Non- 
congruent factors are considered as factors accounting for only one of the factoy 
matrices A^- and Ag* ^ ^ * ' ' .' ^ j 

Now, let us Consider two orthonormal matrices F,p and Fg such that 

'F'F— - I , F'F-, = I , as seen in equation (14). As F_, and F^ are.con-\. 
X J- mrp ^5 ^5 trig i ^ . b ' 

sidered to be normalized factor matrices of A^ and Ag» respectively, over 

» - ■' ^ ' ' * . *' 

each column, * the coefficient of congruence between two factor matrices A^ and 

Ag defined in (35) is simply given by , . . 



Suppose that is transformed, post -multiplying by a \xfiit m^^vectpr " 
V, (v' "^v, = 1), and F^. is also postrmultiplied Ipy a unit nrie'-vector 

'^1 ^1 ~ "^^^ coefficient of congruence b^tw^cn the transformed vectors 

. s • - ^ * ^ • , • ' 

F_v and'FoV, is given by • ' , • . . 



Since • -4;^ , ^^T^'i^^'-Ft^I^^ = 1 , - - . " . = . (40) 

and, , : .( >^ ^^S^l )"(^S^1 ) = 1 ^ • " (^1^' 

S S ^ ' » ^ « ' 



The maxinnization of h. . by choosing adequate weight/" vectors v 
. and V under the condi|;ions (40) and (41) is weU-known problem of canonical^" 

■ s f . .. > - /■ — • 

, analysis -(e.'g., Anderson, 1958). . ' ^ » 

^ We may define • ^ ^ ' '■_.'» 

J = h , - jv{F„v y'(F„v ).-!}- jii {{F V. ViF^v ) - 1} 

^ ' • . ^v;^(F^F3)v^^:iv(;;^^,^-l)-i,(v;^v^^-■l) (42); . 

where X and \i are Lagi^ange^multiplie fs . ' ' 

: ' y 

TDi/ferentiating (42) with respect to v. and and setting the derivative's equal 

to zero, ' ' • • ' , <^ . * 

' a J • • ' . . . 



'ax 



u * •» :s •, T 

= 0 -. ^ ^ . . (44) 



— 4. (F' F )'v .-V-v 

Pre -multiplying (43) by v . and noticing that v v ' = 1, ' 

T . T .X ' ' 

. ''{F^v^ )'(^S^1 ) -1^ = 0 . ^ - (4^) 

Pre -multiplying' (44) by v' and noticing that v' v =1, 



{FjVj ^W^Yj j -.H •=. 0 : '- .- (46) 

; .Since " ... (Fgy )'(F^v ) ; tF^;, )'(F3V )' ■] ^ ^ ^ (47) 



Ac 



- 2.4 



S IT- , , 

^ , V* ^\ = [JL ' ■ •. (48). 



Multiplying (^3) by X," 



(F|Fg) \ v-^^ - \Sv^^ = 0 . • ■ (49) " 



By* (48). (44) y^elcl^ '4^^ ' I ■ ■ ^ 

4 ^ 



(F^Fg)'v^'- 9 \v^, ' ^ ' . ; • ■ (SO) 



. . 'Sub^titijting -(59) into (49), 'A* * » 

^' } ■ (F^FgHF^^V^ -^2v^, 0,. " ^ (51) ll*^^^^--^ 



^ If w.e. let . ■ - 



. . G^^'= (F^Fg)(F^Fg)' ; ' ..- . ' .^'9?^) 

(51), yields ' ' . • ♦ 

■ .. , - '(G„„^'K2i)v =0 . ■ ^3-)' 

Multiplying W^) by |Ji and replacing \i Ipy Xf * -! - »^ 



Substituting, (43) 'in. (54.)." i " . ■ . ' "V- 




' ^ (56)' . 

' To find nbn -zero .vectors \£ satisfying eqiiat^n' (5^) is an ordinary latent 
root problem'', or mf^x^ often tailed an **eigenvaj.ue problem'*, and ig 

. fc » , - . • « 

.• ; . - . ' 

o . , « ■ ■ . J, . : • ' - - . 
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1' 
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positive latent root of G^^j*- Similar relations hold in equation (57). is 
. also a' positive latent root^f G^r^ and v, is a i;ion-zero vectot associated 
^witK 'X^^ The condition that the equation* (53) amif (jp7) have non-trivial solu- * 
tien-irs that is a root of the characteristic equa^tions- 

d ' '9 I Ggg - X2I I =*o ..' . ' ' • . , (59) 

If the rank pff Gip^is r', so is the rank o^-Ggg, and^ (58) and (59) have the same- 
r distinct positive latent, roots unless they are speciarcase/ Let . o., 

'.A^ be distinct positive iftent^oqts of ,Orj^j> such fh^ >, \2 ^ and 



Ijtt V- -v^ , . . v be noh-zero latent vectors asfeociati^d' with thes^ .foots 
respectively. The distinct positive lat*snt ro^^ of C^JLar'e also given by 



* ' \\> . . • L and i^t V, , v_ , V be noX"^"ero^fcent ve.fctots associated 

^ with these' roots* of G^o respectively. , * \» 

. ' If we take the first largest root .and the. associated -vectors yt Tor ' ' * 

G^v and v_ . for. G™, the -coefficient of^oneruence between- F^v., a^d Fr^v, 
. r TT , Ig . . 56 ^^.^^ , ^ - ,^ T 1^. J ^ Ig 

^'^d-efined^by (39) is ma:J4imized,' 




i Ig C . i ^ b ig ^ • . ' » • 

. Sinc^ FjLF^v ^ \ V, *by (43) and v', v, = 1, • 



r 



If*we^ake»the secM;<3^Iargqs> ro^^ and the as.sociated vectoi^s v^ ^ f o 
G^^ and v_ for- G-^-* the coefficient of congruence between W^m^-. and 
Fr^V-. is given by sirhilaip procedure to (61), i.e., / • 'i*- 
' . ' . h. . = . ' . (> 0) I • \ (62) 



FRir 



4^ 



andat is maximuri^in the re sidudl' space defined- by 
Furthermore, it is known that 



K V, = 0 ^ 

'^T S • ' 



» 



and 



h, , = h, " = 0 
1^2g \ 2^1. 



(63^ 

(64) 
(65) 



-T S 



(See Hartftan, I960; Horst, 1963). This procedure c^n be co^nued until the 
vectors v * and v associated witti \ are extracted. 

For simplicity, if we define ^n r X r diagonal matrix . 



A. = ' 



1 



"^2 



.ft 



/ ' (66) 



:4 



and an >^ r ^matrix made^ol coluifan vectors v, , v. , <» o <», v , 



= [v 



equation (.^3)r is expressed in a form 



^yhere 



V' V = I ■ 
T T . r 
/ 



T 
(67) 

(68t 
(69) 



'>'by the property of latent vectors. Similarly, we can define an mg X r mapix 
olfcolumnjVfectors v, , 

©- le 



V 



(Jlf^er to sJksfy equations (43) and (44)^ it will sometimes^e necessary/ to 
'^0(Ld}ust the directions of tlie column vectors of ^nd Vg. 

• 4rj ■ • • • 



- [v < / V 



s 



(70) 



er|g 



Equation (57) is express^ed in. a for;n 



r- 



where * ' V'Ve,,^ I 

S S r 



(71) 
(72). 



These A^i and Vg can be obtained by ordiAary principal connponent i^ethod 

for G^^ and Ggg (Hotel'Ung, 1933; Harman, I960),- y ' / 

By the way,«as seen in the equation's (43), (44), and (48),'- 

and (F;^Fg)'V^ = VgA . . ' ■ (74)' 

ft 

These equations could'be used for' solving the dne-j'set of vectors when the other 
set of vectors is given* For instance, , " ^ 

when V„ is given, and ^ " ■ . . , , • 

"^s = ^^T^s^'^t^'"" ^ ; ^^^^ ■• 

wl^n V"!, is given. Sihce the V^> can be obtained by solving the latent vectors 
of Grp^" and the Vg can'be independently obta£n^d" by giving the latent vector.?' 
tof Ggg> the equations (75) and (76) can be lised .for ^heckihg computation^ 

^ Thus, by the transformations of byj^V^,^^<^ -F^'^^^y Vg , we qan define 
new factor mset^ices B^p and Bg i'h which the, first factor of "B^ i3 ma^i^al 

{ \ ^ / / 'I r ^ ' * > ' 

matched with the first factor 6f "B«, ;the ^Sjecona factor Brp is. ne*i maximal 
matched with the second factor *of ^^^.hplc^ng tl^e orthogonality to the firsts fac'- 
tors, and so on, " until the last at thfe f~th factor of'Brp is least maximal 

■ ' ■ ^ \- ' ■ ^ ■ /; ■ ■ • ? 

matched with the r-th factor of B^ holding their o^hogohality with all other - » 

factors^- These, new matrices are^expi^ess^ by, ^ • * ' 

^^B^,= F^V,jjS^ ^ * (77) 

and ' B^ ^= FgVg ^. • ^ ' . (78), » 

1 • ' . 



' . ... -28 

The coefficients' of congruence between factors in different sets are given by a 

' ' • * * ' ^ ' . 

matrix ^ ^ i . ^ 

*"'Whose diagonal elements indicate the coefficients of congruence between matcKed 
factors and whose off-diagonal elements indicate the coefficients of congruence 
between unmatched factors. .The coefficients of congruence between unmatched 
factprs are suppo"sed to be zero within a rounrding error* As the diagonals of 
B' are arranged in descending order of magnitude! tlfe'last parts of the. 
diagonals might be small and negligible* Only the first several factors having 

* large coefficients of congruence, s^ over 0. 9, could be considered as 'con- 
gruent' factors and the rest as *non-cpngruent' factors. . • 

■^'"Tj/* croas-praduct of matrix 'B^ with(»*it^^lf is the identity matrix; J.. , 



BiB^ = I .• ' ' • V (80) 



r 



'Similarly, 



S S r . ^ • 



* Since Ihje -sums of squared coefficients ot- B^ over n items are all, qne^ ab 

seen irt equationfjljp), the is considered as a norrfialized iaclor coetluii^ni 

matrix fpr teacher ratings. Similarly, the is a normalized factor coeifi- 
.cient matrix for student 'bcorvs. «rhe normali'^zcd factor matrices would be ' ^ 
convenient. fo/ the j.- o^ pari son' feet \^ ee n tv.b factorial stru< tare*, witfi difterent . 
units of jneasunement. ' ' • , / 

By the'way, when and 'A^ are already givep, as seen in the equations 

T . b . , . . ^ . 

(31) an& (32), B^ and Bg could be obtained directly from A,j, and by 
transformation matrices t!j, and Tg respectively.* Since ' * ? 

A^ = F^JL^ , ^ . , ] ^ (82) 

by the' definition^6), then ' , 

ERIC ' • • " . ■ 



^ h^--i'; • . • V ' . (84) 

1(85) 



5 



4^ 




(86) • '« 



(87) 



(88), 

and V_ -ir-L- 1 V„ . (89) 

boo « ^ 

In the n^xt few paragraphs, the computetional. procedures for dct^rjnining 

'^'^ . ' •> 

factor matrices/B^ and will be summarized. 
_ T ' o . 



SuiYimary of the Computational Procedures * * ^' ' 

1. Obtain the intercorrelation matrix Rrp between r{ items judged by^jteach- 
ers and the inlercor relation matrix between the same n items per/orrned 
By'studentS . , ^ ~ • 1^ 

2. ' By the principal cbniponent method, find a diagonal m'atrix L " con** 

sisting of the'first m,p significant latent roots of ancj their 'Associated umt 

♦ 

yectors Frp where .P^F^ ^ . Simil^afly, find the first mg significant . ^ 

latent foots , matrix. L*c? and the associated unit ve'ctlor's F^, of R^ where 
4 o , o o 

' ^ * * t . • ^ . ' 

S S \mg ^ ; . ' 

, 3, If desired, compute = Y ^L.^ and Ag = ^s^S ^^^^^ Y^^^^ P^^^^^'P^^ 

components of and R^, Respectively, in Hotelling *s • s^nse 

4. D.etermine the positive latent roots matrix and the unit vectors ""V^ 
of Grpj defined Grpj = (^^-^s^i^T^S^' principal component method. 



5. "Obtain Vg =^ (E;^Fg)'V^ A"-^ ' , ' - _ 



-ERIC . ' • ^ W . , 



4 

30^ 



,6. • Using the principal corpponent method, find the positive latent rpots 
matrix? and the unit vectors of Ggg = (Fij,Fg)'(F|j,Fg) reflecting the cof- 

• * » * 

umn vectors of V-, if necessary. Check if J^^ and are equal to those jEound 
in the steps 4 and 5> respectively. ^ * 

y 7-. Obtain = (F!^Fg)Vg and check if it is equal to the values of 

found in step 4. . * • 

.8. Compute the = i;^V^ and Bg = ^s^S' ^"^^^ ^•T ^^^^ 
the most %ontruent factor matrices with corresponding columns. . ^ 

9, ^ Compute = ^T^S ^'^fr^^ elements are the coefficients of congru- 

ence between t^6 sets of factors. Check if t(B' Bg)^ is equal to the latent root^^ 
matrix A*^"oi^G,p,p (or Ggg) obtained in step 4- (or ste^p 6). 



r 




CHAPTE" 
THE COLLECTION OF DATA 



1. ' The Construction of Acihevefi*ent Tests 

Our work started on the construction of test booklets for. students which. we^e 
based^on the first five chapters of 'High School Mathematic s,\ Course 1 by 

.'^ c • . / • 

M.. Beberman and H. E'. Yaughan (1964^, T 
. The contents of the fi-rst^five chapte*rs* of the te-kt are as follows: 
Chapter 1 Nuinerals 
Chapter 2 Real Numbers • ^ 
Chapter 3 Properties of the Real Numbers 
-Chapter 4' The LanguagI of Algebra- 

i 

^ ^ .^^ Chapte^ 5^ Operations and^nverses ^ 

Forty-three percent of the total pages of the text are in th^ firsj five chap- 
ters, and these chapters are pre'sumably to be st&died within the first semester, 
even i«n- the slowest class. * 

Determining the format of the tests posed a problem. As our'purpos-e is to 
"^find a factorial st^^ucture of a set. of tests having different contents, ^'intercorrela- 
tion coefficients betwieen these tests have to be computed/ To obtain reliable^L' ' - 

correlation coefficients, however, it would be desirable fhat ea<:Ji ift-st, in the 

' . * * ♦ - • . 

general sense, ha§ an interval scale whqse scores distribute in several ordered 

categories rather than in the two alternatives, of right or wrong answer s . the 

same time, we want to -prepare differ'ent kinds' of tests in great variety so that 

fio important contents are excluded from the given set of tests. It is a kiAd of 

dilemma to require both that long reliable tests and ^hat many , kinds of tests are 

o be given at<the same time within a class h(&ur. . ' 



^ As it was estimated that nearly a hundred short g-uestions could be answerfed 
within an hour ^^f&ss period, two test booklets were constructed, designed to 

^ solve this dilemma. The first booklet, which will be called Tes,J: I hereafter, 
has twenty-five items all but two of which have four'sub-items^, Test I covers 
the c6ntents of the first three chapters of the text. As indicated earlier, these , 
groups of sub-items treated as units, i.e., as tjie items for teacher judg- - 

*ment and as short tests of student achievement. They are hereafter referred to 
as items — the items of the tw^o test booklets. 'The second booklet, which will be 
called Test II hereafter, has twenty-nine items' covering the contents of Chapters 

# 

Four and Five of the text. Each of these items also has four- sub-items except 

one which is a theorem-proof type of problem^* The sub-items within each item 

are similar to each other in conten't^and controlled by the same instruction. It is 

as^med that the sulS^items of each item measure the sarrie ability, and the 

ferences acnong them depend n5t upon the l<?inds of content but upon the degrees of 

difficulty. • * • ^ 

Special rules were adppted fon scoring the e,xceptional items. Items No. 5' 
, ** 

anVi No. 6 of Test I were simply^ scored right- or- wrong, because these items^ 

r ^ ' ' ' ■ 

needed^ mo re space for presentation, and there was sorpe diffic.ulty in making 
fpur questions* of the same kind as well. So as to c-bnform to the other items in 
scoring, a'credit of four v^as given for a correct answer and no credit fqr an 
incorrect answejr to these questions. Item, No. 29 of Test II was also a single 

questichi having no sub-items, but the task was t9 prove a theorem by a $tep- 

s - ' ■ - . ^ 

by-step deduction,^ andT the students' work was graded from zero to four. 



it 



Tl>is idea would naturally lead us to tKe concept of radex theory developed 
by L, Guttman (1 954) by which sub-iterr\s within the same item are.,to con- 
stitute a simplex structure. The ite^lrns here, -h^^^ver, were hot actually ex- 
amined from this point of view. « ' . ' 



All the rest o'f'the items tiave four sub-items, /o each of which a score of 
one was given if the answer was correct and zero if the answer was incorrect. 
Consequently the scores on each item were distributed over the range from zero 
tb four and the resulting scale was treated as if it were an interval scale. Some- 
one'mig^ht say that the. range of the scale is still too narrow for computing a 
product-rnoment Correlation coefficient,' but we preferred to collect many kinds 
of these very. short tests (items) to having langer^but f^wer tests. There is one 
practical advantage^when the maximum score of each item is four. When the 
gain score of post-tQst from pre-test is computed, the maximum gain score will 
be positive four and.the "minimum negative four. By^^addirig a constant value of 
four to every gain score, the range can be changed to from zero to eight without 
changing the variance and correlation coefficients, and it is punc^habj.e in one 
column of an IBM carc^ ^ ^ * * ^ . ^ 

. The items given in the^^o test bookjlet^^re shown in Appendices C and D. 



Fpr convenience, to refer to an-item ol Test II in l^er discussion, one of the 

*consecutive"integer s from 26 through 54 will bf used as shown in parenthesis 

by the^original ilem numbers of Test II. In Test I the item numbers from 1 to' 

25 will be Used, to refer to the items. ^ 

Data on more items were originally collectt^d,^ especially for^Test I, for 

experimental testing, because the pre-test at the -start of instruction of the 
' " • ^ y 

course was the first such experience for us, and we, could not figure out in-ad- 

2\ 

vance how studenjts would re^ct to ^uch testing. From the experience of .ex- 

^ • * 

perimental testing with three classes- at Arlington Heights High School, n^ar 
.Chicago, both the to^D-easV items and the time-consuming items were deleted, 
and the number of items was reduced to 25 so that rnost students could try every 
item within a class hour eA<en on the {^re-test administration. This was par- ' 
ticularl^necessary in order that- the intercorr elations between items located 



5. J 



near the end of the booklet would be meaningful. Iterms in Test I in Appendix C 
and Test II in Appendix D are the items finally used. 

For both Test I and II, some items contain sub-items of the^ multiple- 

^ • . ' % 

choice type, c some contain completion type items requiring a simple numerical 

• ' - * 

computation, and some require that students have a logically written solution ^ 

like the proof of a theorem. To increase the 'variety .of items, some of the sub-" 

items are the same as questions in the text except foc^ the given numerical values 

while others are-less closely related to the examples in the text, aUhohgh the 

• ' * 

given objectives are the same. Some of the sub-items are, not given in the text 
at all or are based on material given in later chapters*. 

In Tables 1, 2, and 3, the items are classified with respect to (1) the form 
of answer required of the sifj^ents, (2) the abilities required to answer' the ques- 

tionsj^aind (3) the degree, of relevance of the content to the text. In Table 1, 

' . . • • - ' S ^ * 

the answer forms are classified into three ca-tegories, (A) multiple- choice form, 

Tb) completion form. with simple numerical values or algebraic variables for 
ans'wers and (C) c^pmpletion form with iome written work. In liable 2, the 
items are classified according to whether j'heir questions are based on (A)^h^ 
student's understanding of basic mathematical concepts, (B*) the student's com- 
putational skill, or (C) the stude<;ifd ability to apply basic mathematical prin- 
ciples. In Table 3, the itenx| are classified into three categories. If the ques- 
tions^ ar^the same as or a slightly ^odifi^d form of a question seen in the text, 
they are classified as A. If th^ cpritent of the questions is based on the text 




but Some ability of tra ^ife^ rorn the text is required, the item is classified as 
B. If the content* of the questions is not. treated in the given chapters or ii>rel- 
evant to the te^xt, the ifem is classifig^.^^-^ . Briefly, the items of Type A 

- • " ' ' 

.contain questions closely related to the text, the items of Type B contain pu'es- 
tions moderately related to the texts and those of Type C have questions least 
related to ^he text. - ^ • . ' v 



^ The items in the two tests were based, in part, on a file t>f test items which 

the^UICSM Mathematics Project had developed as achievement measures for its 
first course. Some modifications were made. to confor^m to changes in the 
' latesf revision*of the-lext. Some new items were created io cover more adj^- 

quately the chapters in the text. In this process, consultations were held wath 
. the project director and several other .staff members. However, some items ^, 
.were included which didjpt fit the text well in order to allow more opportunity 



for teachers to disapprove items. The classifications described above were 
made by comparing the.items with the examples and exercises in th| text? 
Although jthey were done subjectively by the author, they were made 'only after a 
• considerable amount of detailed discussion of them with staff members an.d 
■ experienced UICSM teachers. ■ ^ . . ^ 
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, TABLE',,; 

f 

V 

•Classification of Items with Respect to 
Answer Forms ■ 



Frequencies 



Item Numbers 



A: Multiple -choice 



26 1, S, t). 12, I'i, Ih, 19, 20, 21, 

C 24, 25, 26, 28, 32, 35. 3b, .3t, 40. 

/ % 41, 42, 43, 44, 45, 4b, 49, 50 



B: Filling with Numerals 
or Algebraic Variables 



17 2, 3, ■ 4', 7. 8. 10, 11,^13, 14. 

17, l-§,, 27, 38, 39, 51, ^52. . p3 



C: Written Work 



1 1 .9, 22, 23, 29! 30, 31; 
33, 34', 47, -48, 54 



m 



54 



TABLE 2 



Cias sififcation of Items with Respect to 
^Required Abilitie.s' 



Frequencies 



Item Numbers • 



A: Understanding of 
Basic Concepts ; 



19. 1, 2, 11,' 15, 19, 20, .21; -22. 24, 

39. 40. 41, 42, 43. . 44, 45, 46, 48- 



25, 



B: Compu^tionai 
Skill • 



16 -3, -4-, • 7, 8, 9, 10, 13, 14. 

17, ,18, • 26, 27,- 31, 32. 33; 34 



Ability of Application of 
Basic Concepts 



19 



54 



-5, 6, 12, 16, 23, 28, 29, 30, 35, 
,37, 38, 47, 49, -50. '5"1, 52, 53, , 54 



36. 
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TABLE 3 

Classification of Items with Respect to 
the JDegree of Relevarfce to the Tex^ ' \, 

Frequencies ' Item Numbers 



A: Closely Related 



B: Moderat^y* 
Related 



O: Least Related 



22 



2a 



12 



I, 2,. 3, 4, 7, 8, It, 22,^ £3, 

,31, 33, 3b, 39, 40, 41, 42, 46, 47, 

5. 6, 12, 16, 24, 27;.. 29, 30, 32. 

.37^ JS, 43, 44, 45, 49, 50, 51, 52, 



26, '28, 

48, 54 



35, 
53 



■ 9. 10, 13, 14, 15, 17, 
18, 19, .20, 21, 25; 34 




* , , 2. J. The Sample*lDf Stddent$ and Test Admini station 



* «Test r and TBst II wei:e given to all ijie students jvhp w.ere asing*the new 

text,|| High School Mathematics, Course 1, lYi the Pekiii Comnaunity Hlgji School 
' - ^ *. ™^ ^ ; ~ ^ ^ \ ' » ' * it^ 

in Pekin/ IllinoiV. They .w^rle., ;'9'th grade students.. - *^ 4 

^ Test I was a'dministered as a. pre- test on September 11, 1964, within 

. / * ^ * . 

4*iree da)^. after the new Sj^rnester started. Test I was also administered a^^a 

post-td^t*on O^tobe^r 1^ withi'ji a few^ays after instruction in the first three 





^chap.ters was firiished. 7^st^TI ^i^Bfr^-test was 'given on October 16, the nej^t 
day after Test I ^^tf&give^^ Te.sf^-II^fes a ^posj-test was give^lfin Oecemberv 2 1 , 
^h^n instruction in Chapter^ four and Five wa'5 firfished in gipst classes, the 
- tefsting time wa^ sixty minuted for each admi-'nistration using an ordinary cla'ss 

; , ^ • ' ^ ^ . ' . • 

^-*-.-hour: ' ^ ' ; ' \ - /, f : * • " ' . . . 

The dipeft|^ns to the. students. at the pr e- t^'sting^ time on both. Tests I and 

II were as foll5}A^s: - V ' ^ - ' . ' 

•if' ' ' • 1 . 

^ * This,' test contains a number of que&tions on mathematics . 

^ ^ designed-to .de te|"mihe wha^'you iriay already know, of some topic^S 

y^u are , going' t6*, study • ^ ' ^ " . . ' 



" ' _ MosI ot^tfte^proble^ms in tKis test are clpsely reJlate'd to wha^' 

W^ijp ^ "J^P havjp fetudiqa fir evi.ouslyC,. _Therefo^ , > you cartlSfteTi gue-ss 
what the'Janswerj is| klthoug];x the way in Wbii^ch the prablerri is * 
;^ • ' ' " ^ .W^tteh rfiay*be^nfew t6 you. { . ^ , ' ' 

V .* * This•test^v^ll b^used-ctA. fi<^^d out v/hat connections you 

-^^i^^^V'^ can see betweeij wha^pu have studied earlier and what yow 

•* ' are abotit tTo study . ^4f,However, if you carl find no way tg -soLve 

" I * ' iome Okf'ithe f>ro|Dlem's, do npt worj-y, Ypu are rfot expected' 

^ t *■ ^ tO'Jpe familiar v^ith ^11 of thi, que stions ^Jthis test ,wilL not . 

* ^ ,t ..-^^af^'ct yc^r'^i^ad^, . ' ' ' * * - , ; ' 1. 

» ; Tryjas hard'as pOS;^ible*.td~^l||wer each question so thai ^ 
V ,J " you w^ilhave a K^gh scpre.J Whert you *n1^et a difficult qufs-- > 

^ taor!%ndidb»'t ^4ally1^now tfie correct answer,* guess at it,' ^ " ' 

' and youy^ay be|rrght.' r , . i ^ */ \ 

To sp.end njan^^pbinute^ in answerifig one cjue stion 'would ' 
not be wjise *^since the total tirne allowed is limited. .ypu\\vill 
•'^haVe unt^l the prx'd of the cla-ss -hour* to work oi> the" test. 




J- On Sonle questions you will have to write .i^\our 'g^nswjer Z^-* ' 

lie Qn other ques^ons you will have t'o circle tl>e corr^ct^ne ^ ' ^ 
of several choices. J ^' ^ * 

Read jCarefuUy the. directions fof' ^ach Question, ^ i 

\oM may .do •scratch Work right on the pages 6£ the test. * ^ ♦ 

■. ^ ■ ■• ... ^ ■ ■ . 

' If you have done all the problems and still have time, you - ^» 
n>ay reread the questions*" and check your answers again or you* ^ ♦ 
nlay'do other work that dqes not^s'turb'^th^r peopl^. ^' • ' 



If yBu have questions while. you are working, raise your 
» na^d*^ . 



\ The frr:$|. few paragraphs re^isiat the^pre- testing time we^re unnecessary at* 

the jJ^o St- te siting time and the directions were^ simply; 

' This test contains a number of questions pn mathematics 
v.^ ^you have studied, Try'as J^ard as prD6sible to answer each ques- 

Uon so that you wil^ have ^ High ^score. When you meet a difficult * ^ 

♦ question and you doh^^'really know the correct answer, you-may 

guess at it.. This tea^-' will not affect your grade. . ^o spend marjy ^ 
minutes in answering^one-^uesti(^ would not b^^. wise/. , , - v 

« / '4- ^ , • ' " ' ' . r ' ^ ■ ' ' • 

The rest Q(fcihe directions were fKe same- as those at the p^re-test administration, 

. • T ■ . • • - ^ ^ ) . ^ 

.As- mentioned earlier, however, -the original experi-mental booklets having 

appro^mately fwice as many items as Test I were given to the students 6f 

-^^lington Heights^High SchooL The<6ame booklets we-r^ used for'the i^eW^High 

w School students at the first prfe-test admihistratiojjp A^special directioTT was ^ 
, ' " ' - . . - . i ' . • ' 

* \ g^ven th^fel to cross out,the jtems which we^O^ not "silppOsdd to be worked. For , 
he ^^tjtjf the" teslSRg; no special djr ectibnawae necessary. . . . 

j:luding the students who were absent on.any of t)|e four test day s,/thfe^ total 
numbeij: of stud^^ tdsted was 464. * ThC |number of classes was six, and^four ^ 




. teacher? were teaching these classes, sthce two classes ovif oL-six weire taught 



M^J>y the ^amC teacher . The averaj 



J>7T:he ^samC teacher . The average registered class , size was appr oxPfffSlely, 



% 

1. * ' 



r Er|c \ \. - « 



3/ The ^Construction of a Questionnaire 
^fof TeacKers 



Our second task was to make a questionnaire*asking the teachers who were 
teaching the new text' to" jucig^ ^the sjuitability of the items in the t^vo- tests ^or use# • 
in achievement tests in^Xheir own classes. After trying several forms in personal 
inter^views, the questionnaire shown in Appendix B was constructed. In this 
questionnaire the*instructions to the teachers concerned with Test I is as shcgg^n. 
T^ie ^instruction concerned ^^ith Test II was the sam^|except that the underlined 
"words were replaced by the w^jj^s^ in pjarenthe'ses.^^PI 



Using the scales below, r4te all of the items of the en- 
closed Test I* (Test II) .j- lodicate your rating for each item 
•by placing an *x* in onelof the 10' boxes df the scale oorrre- 
spon'ding to the item. J^ark the box ou each scale which 
indicates how^gpod the item would be, in your.opii^ion, for 
inclusion in a test to be givei^ at the end of the first three 
chapters, (Chapter 4 anii 5) of the new.UICSM text for 
course one. ] . * 

- Every item except >No. 5 and No. 6 (No.' 29) ha§ 
four sub-items. You sHdald ignore diffefences^between the ■ 
sub-items of a given item and ra ^r '^ g ach .item^as- a whole. 

'^Please, do n4&t omit any items. Tf,you can describe 
the reasons for your rating briefly, do so, in the space pro- 
vided aVthe right of thepating scale.** 



The rating- scale'" usejl has ten points ifrom zero* to nine which permits ratin'gs' 
to* be i^U^^ed in one column ol ajn IBM card. Point 0 I's specified as^P^vorthle^s 
itSqn; Pointy 2 as an Jiniferior ' ijem. Point 4 as 'good*. Point 6 as *-sijiperiof 
and Point 9 is apecifWd as a. 'perfect* item^ It'rom past experienc-e, y/e had . 
learped^^hat feachers'^re- likely ayoid an unfav?>7r able, rating to such kind of ] 
qlRgl^ion,^ arxd conselquently the distribution of^scale scor.es tended to bfejneg- 
aAivel^ skewed. In the pre.aent $cal^, theh^ th(^ referetice worda have been 
slightly forced to the lovier">level in the range qf ,the scale given so thatithe 3,ver*- 



age score would locate near the 



middle of the scale. (!i^ctually it was 5.82.) 



In addition^to tlae ratijig, scales, son>e queations asking about past experi- * 
ences concerning" their, teaching *and abaut their education were included to 
provide a HBpre adecmat-e description of the sam'plp, Tavo Questions about the 
teacher *s own attitude towarjd teaching UICSM matherpatics- and^ge?er ences 
conc-erning a test cohs'trucTtion 'were also include^ so as to be helpful for the • , 
interpretation of ^ge result of factor analysis of test ijtems. Th^'fee qu'estipns 
are only used for informal comparison and were^her efor e not intended to • 
'represent an exhaustive or s^^-stematic measure of a^ttitudes. However, both of 
them hati been tried out by face-to-face administratit>ns of an earlier version 
of the^li^stionnaire to teachera at Arlington Heights High School. For.. details 
of thes€questions, consult the sample of the questionnaire in Appendix B. 



4. The Sample of^^T-^acher s ' ' \ 
* * . 

The questionnaire together with copies'of T^^Bts'.I and Il^were mailed'tp 
approximately two hundred teachers who were using the new^ UICSM text, Course 
r. These were aU the^.teacher s in the United States who coulci' be lotated^ho were 

using this edition of the text. The number of questionnaires tjetufned i^ time for 

•' ^ » 0k 

our analysis was 105. ' This sample of teachers came frcypi seventy different ^ 

schools- scattered in nineteen states including fouJr teachers of the Pekin Com- 
rrtunity High School, Pekin, Illinois, whose classes were use'd for the testing of 
students' ability. SThe geographical distribution of the teachers who cooperated 
in our study is show^Vn Table 4. For twe^gf^four school^oiit of seventy, two 
or*more teachers fro^n 6ach school replied to thq questionnaire,* and for the rest 



of the schools one teacher di3* * ^ d- / * ^ ^ * 

' * The questionnaire was sent and* collected ^during Ja^nuary through March, 
1965, A^ the new text was published in September 1964^ the questionnaire was 



sent sufficiently*'long after waxi4s_^at most teachers should have studied^the first* 
five, cha'pter s of the text. In,fact, there was no teacher who i:epor t^^'tliat his 



class had not finished the firkt fi\(e chapters at the^time when' the 'questionnaire 
was completed, ' ' ^ -J <^ - ' • ' 

Forty-tTiref teachers o^it o j^UO > were women. The distribution of the year's 
of experience of teaching mathematics* is shown in Table 5, The most expe-^ 
rienced-teacher had taught ma^thematics for^-foHy years. Fur two teachers this 



was their first/experience in teaching^ mathematics . • ♦ 

NCL7_ ' ; . ; -v • 

The first fi\e chapters of the* new^ UICSlM text for Course 1 are closely re- 
lated to the Units j and ir of th^ old ve,rsio|n of the UICSM text ^blished^ith 
s,Qft covejTs. ^Table^b shows the disti*dbutiok of^the, years of experience of teach- 
ing Units I and ll, whuh shoi^ld be a g o o d j n d i lion of the preparatory ex- 4 

perience'on the contents ^of the first five chap.ters of Sie' new UlCSM text. For * 

' \ , s ^. ' ^ , ' f \ . * ' 
thirty-seven t'eathei^s, thib was the first experience of teaching with a UICSM text 

As seen in Table 7, iweniyTtwo teachfer.s hkd not taken any co.urse in which the * 

contents of the UICSM curriculum were stupied. Most teac her s, , howev er , had, 

1 » 

L 

taken one or ,two suth courses and s^^en ha\c taken more than four such courses; 



Sixty-one teachers a<. quired this training iA. one or mpre summer institutes on 
the IJICSM currkruluVn. * ' - ' .1 - . . 



TABLE '4 

* - ^ 

Geographical Distribution of the Teachers and Sch<?ol^ 
fronrr Which the QUestipnna^es WerejCoUected 



..States 



Nu^mber of 
Schools 



•Number of 
Teachers ' 



California . ^ 
, Colorado 

, Hawaii : 
^\ Illinois , 
Indiana* 

Kansas, ' . 
•Maine \. 
MassaxSusetts 
Michigan 
Minnesota 

Missouri ' 
Nebraska 
< Nevada 
New Mexico 
Ohio ^ • 

. ' ..^Te^as* ' 

^ T^tah ' ^ 

Wisconsin 
Wyoming t 



4 
1 

15. 



7 
10 
1 

27 
9 




3 \ 



105 



\ERJC 



/ 



tabXe 5 



Distribution of'^S^j^Years of Experience 
^ ♦ • di Teaiehing Mathematics'" -\ , 



43 



Niipjber of^ 
Years - . 



0 1^-2 3-5 6-10 'll-lS L6-20 * 21-30 31-40 



Suin 



Nunciber of 
Teachers 



2 , 17 21 



3Z 



18 



4 



105 



r 



TABLE & 



•# Distribution oi the Y^ars of Experience of 
Teaching Units I and II of, a 

thp UICSls^ Oid^^Text, " ' 



Number of 
Years 



No -f • 

, Experience . 1-2 



3r5 



Surrf 



Number of 
Teachers 



37 



^' 36 ^ . - 2S 



105 



1 
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i 
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TABLE 7 

- Distribution of the Number of Courses Taken in Which 
the Cc>ntents of the UICSM Curriculum Were Studied • 



Number of 
Courses 



4 . 



Sum 



Niimber of 
Teachers 



22 ; 40. 



20 



1 * 



105 



' 1 



ERIC : 




6^ 



4 

1 ' / 



CHAiPTER IV • 
RESULT^ 



1. Means and Standard Deviations of.Item D^ta < 
Means, and Standard De'viations of the Student- Scores for Each Item 

•^bLe 8 s-hov^s the mean scor-es and the standard deviatiohS' of 154 students 
for each ite.m/ Column 1. indicates the c(^p0^^iiitive item numbers for Tests I 
and II. Columns. 2, 3 and 4 indicate the means on pre-t^sl, post-test and 
gain sQores, r.es.pectively. Columns 5, 6 and 7 indicate the standard deviations 
of pre-test, post-test, and gain scores, respectively. Since th^ scares of' Items 
5 and 6 can only have the values of 4, If correct, and 0, if incorrect, the 
standard devia^tions of these items are relati\^ely larger 'than those if other 
ite^s. ' * . ' ' • - ^ 

' Tables 9, 10 and It show the frequency distributions of mean scores on 



the- 54 items for the pre- test, post- test, a^d the gaip< scores, respectively. The 
item numbers are also shown in these tables so. as to indicate which items w^re 
easy, Which items were difficult, and so on, ^ j 

Aslseven^in Table 9, a fairly la^r^ijiufnrber of Students correctly answered 



the iterhs given before th^ instruction began. The nfio.de of the" distribution is 
between 1.0 and 2.0, and the average of scores ^ver all the item> is 1.79, 



wbich means that, on the'average, the students cor fectly "i^iswere^d a^out 45% . 
of the &^b-items before' they studied'the content. Test I was easier than Tx^st 
It» Intact, easy'iJems were collected for Test I because we werfe afraid of 
discouragifig. students-.by giving unfamiliar questions at the pre- test adfViin- 
istration* ^€hy-the basis of the experience with th^ pre- test of Test I, mpre dif-. 
* ficult items^were included whjen Test II was made.^ The average jDf mean pre- 
test'scofes 'over Test II was 1.64, and over Test I it was 1.96. 



' As was cxpt'ctccj, the distribution of the mecin scores from the *post-.tes^^' 
ach3uni^J;rajionb is negatively skewed as, seen in labk- 10. , The average of post- 

X^'ht mean scores over alLithe itenx.s is ,2.68, indicating that the students cor- 

\ ^' ' ' ' ' ' . ' - . ' 

rec'tly answered S-bout'^TTo ot the sub-items,, on the a\erage, dfter studying. the 

content, Th^e average of mean post- test s*. ore-rf over Test I is 2 . 8J , and over 

T&st II it is "2.57. btudents'^lbo did bettet (or "Test 4 than fo^ -Test II at th^ * 

post-test administratio'n, „ ' ^ \ . ' . v 

" .Looking at ^ht- gam from pre- test ^^poi»t-tebt in Tdble' l^, 47 items out of 



54 have mean gains dis?t'ributed vMthin a rdn^e iruHi O.OD to* 1.50. ^he, averig^-^ 

of mean gains is 0.85 om r Ti st I, 0.94 o\(r W-^i II ^nd. 0,90 over all^he tes 

• . ' • ' i 

items. Students ga; ncdj-nort on th< harder Tebt II lhcin*they did. on Test I. ^ 

w ^ • - • • . 

Generally speaking'. Test II v,as .i better inhlrument than Test I, cpnsidering 

" r A ' < - ■' 

the means ol the pre-t(*st, post-lot, *and ua.in score's. 

'I ' . , 

. ' The relationships bctv^een the three kinds oPmean scores* ar« shown in . . 

Figure 1, The diagonal lines indicate the amount> of gains . No item is Tocated 

' ' J ' ' ' ' . - " . 

on the4ov/er right-hand side ol thp main diagonal, which means that there ^is no 

itern with a gai^ in tht *negatj ^ e direction as •far "as the mfean score is concerned. ^ 

Items 1 and 8 show excessively large gains. ^ Item 34 is. tog advanced to expect 

much gain, sinie exe-rcises hke.it do not occur unt!lilate,r m tb.e text, Item% II ? 

and 41 are>too easy to have much'gain. . Items 12, 17, '27, 40, and 47 ha»ve. ^ 

large gains and* they are must desirable items', if the gain is taken as. a critejionf 
• . . _ ' / . ' ' . * ' / ^1 

of a good achiey^ment- te St item. As.suming the null hypothesis that no gain Vj^as \* 

in the population frorri .whicH the^ sul^ects were drawn^ tho distribution of ♦ 

,ple mean giiti scores of an ;tem may be approximated by the t- distribution 1 

e.n ,the nud^r, of subjects is la3jg;e, even thu.ugh the distribution of^the gain . j - 

scores^f^m itenri in the population is --not normalj^Hay s, 1 963, p. 308; Walker ^ 

and 1953, ,p.. 143)^. The hypothesis of no ifaiji in tile population cannot be 

ejected at the 5% level of sigfnificance for Items 6,« 9, ^ TO,. 13, an^l^^^T) ^-nd | 




at the 1% l evel for Items ZO and 41 't)y the two-tailed tebt (Walker and Lev, 
1953, pp.\15lff). All the re-sl" of the items ha\'e gains that are significantly ^ 
different from zero at the 1% K/cl. Examination of the content of items h'aving 
large or .sm^.11 gains is interesting and, important bat it will^be. postponed to the 
nexr*ehapter . ^ * * 

As for the standard deviation of gain scores for each item, it should be" 
noticed that there are general tendencies such that, (1) the stand^^h^viations 
of gain scores are li.kely to be greater than either those of pre-test^or of post- 
tt St scores, (Z) items having extremely high or low mCcHis have smaller stand- 
ard deviations than 'items having means neA: the middle of the possible rarjge of 
score distribution. 



Means and Standard iDeviatio-ns of the^Teacher Ratings for Each Item 

r i 

Table IZ shows the mean^ and standard dexiation^ of 105 teachers, ratings 
Ao.r the same Items as Pi\,en to the b-tudents?. Itt m numbers-in the table corre- 
,-pond to the numbers u^t d foi;^ tudt nt data in Table 8. The posbiblc- range of 
ihv rating scale '0/to 9 and the ii^iddle point of the scale isM.3. (S^e the 

^ ' j • V.J 

sample que s tionna; r^' tont-iining tlu- -rating svah *> in Appendix B.) As the mean 
i.rigi 



i , ' i - ' . I - " 

rati.rigs oVer all the items li ^.8Z, it'Lndicates that teachers are likely to rate 

I ' * ' ^ J • 

items toward the faiorable direc tion, .The means of the ratirfgn b«c-attercd m a 

range from 4. 5- to 7j. 0 as showij in fable 1 5. Cohsi^dcring that the possible 

I ^ • \ ^ ^ ^ ^- ; i ^ ^ 

''range is divider for teicher ratings than for student Si^orei^, relative varia- , 

bility of the m^an values of teacher ratings .srhaller than that of t)ie student 

\ .4. ^ ' / 7^ ' ^ . ' 

Scores . ? ^ ^ ' . ' ' * 

, In aijder'to see t^e miitual relationship between mean valjaes of teacher 

ratings ahd student scores,^ p^^nts having tW.o irean values as^coorclinates are^ ^ 

i ' • . . ' . 

plotted for each itemj in Figures 2, 3,^ ana**C These figures show rys'^ecfi v ely 



the rcl3.tionship of means of student .pre-tes^^ post- test, and gain scores with 

teacher ratings. In any case, there seems to be no strong relationship between 

student scores and teacher ratings. If we compute the cor relation coefficients 

for these bivariate distributions of mean values, -O/JS is obtained for the pre- 

t#t, 0,03 for £he post-test, and 0.22 for the gain scores. ' There is_a^ery„_r 

slight tendency for correlations to increase^from pre-test through post-te>st to 

gain, b*ut it i*s non-^significant. ' ^ ' 

Examining details of Figure 4, however, the, low correlation coefficient 

must l\ave be^due to a small number of'sp'ecial item's such as Iterj^s 7,^8, 17, 

and 18. Item^s 17 and 18 are rated lowest by. teacher s anjd Items 7 and 8 have 

excessively large gains compared with other items. li we take off these rt)ur 
; ' '4 ^ * ^ 

items as special cases, the correlation coefficient of mean gain scores with 

* : ^ . ^ ' ' . 

mean teacher Irati'ng increases from 0.22 to. 0.^5^3. There seem to be^ no spe- I 

,1 , ' ' * • " 

ciaritems like thes^e in other pre- and post- test cases. Even if we take off S\i 

i ' • - • > " \ 

items as 14, UT, and 18 in Figure 2, such items as 13, 14,- ^8, and 34]\- 

, m * 

ixi Figure 3, the corr^ation coefficient would not increase as in the case of^ ,^ 
mean gain scqres. It may or.may'not be. recognized by the'te^chers themselves, 
but it seems, t^at teachers' do tend to evaluate te^t items \Pith respect t6 hov^c v^ell 
they measure'student impr ov^enfent throL^gh' the*cou2*5e rather than the simple*^' 



ability to answer qu^tions at the pre- a^id post- training Stages, ^o^^ever, \ ^ 

• ' " . . ' 

this is not a strong tendency>-^ . . * . . ' . 

■ • ; ■ ^ • . . i - • ' . . I • 

It^hould be borne in, mind, in interpreting results, that the*re was no di- . 

\ ' ' ' . ^ 1 ' * . ' ' '1 

- } . 1» - ' I ' * \ 

rect connection betweeji the samples of teachers and students in these analyses. 

The sample o^ teac.hers represent a wide|area of the^U^ni ted Stands v^hile'tTie sajm- 

\ . ' ' V: ' . i ^ / . M ' 

pie of students are from pne local high s<jhpol in Illinois. 'The students in the 

sample v^ere^ taught by only four teichers;, who, constitute, pnly a small part oX ^ 

tl^e total sample of teach^ers. ^However, it stiould be '^worthwhile Ippking at th^ 



relationship between the mtan values of these f*our teacheVb* ratij^s in rela-. 
tiojiship to their students ' perfQrmance^. The numbers ift parenthese<s in Table 
12 indicate thewiean values of thusc" tcaChe^rs* ratings. If we compute the cor-* 
relation coefficient, over 54 items, betwee'n the mean ratiogb of these t9*acbers 

.from Pekin High J^choot and fehe mean_xaJtLng.s_oil_the entire sample^ " C^'T' if 

obtained'; Thus*, the m^an ratings of Pekiri'High School teachers are positively, - 
but not highly, related to the mean'ratings of the whole grQxip>^o-f "teacher s. Itei^s 
13, 14, 17^ and 18 are rated lo\s by bdth Pekin ^eachers and all the teachers,. 

Items 24 and 45 are rated high .for bothTekin and >a'll the tea^iihers. Items 15, 

* - " ^ ' • ? , ' . - 1 

16, 23 and 25 are rat^d highway the Pekin teache^p^,. but they. arc near the-a*ver- 

age for the total sample. Items 35 and 37 are r^t^d. high by the total -Sample, , 

but they are rated slightly louer than average by the Pckin teachers. Items 21 

'and 22 are rated low by the tot^,l sample, but they ^re slightljy higher than aver- 

• ' - • » 

age by the Pekin teachers. . • - =^ . 

It.is important to sc^e^ihow thest; items aVe related to btudpnt performance'. 

In general, 'the correlation coefticients bet\\< t-n thie me-a n ' ting for the Pekin 

High School teachers and their ;students' performance are vVrjy low, and no , 

ga^rticular relationship v. as found. Ihe t:orr,elatio.n'Coeffiei(?rits, over. 54 iterns, 

of the mean.studertt pre-tej5t, pOi>t-test and ^ain scores"v.ith ^nean r^atings of 



Pekin 



teachers^rc, respecti\ (il>^ , 0.04, 0.4 0 and 0.07, 



As w'd'- have jnist indicate in the analysis of the r clation'bhip betweeni means 

of student gain sc^^i^eb and meaens of total te ac he r ''rating, a* positive relationship 

was found. when a few special items were taken out. The peciiliarity of these , 

items still holds for the re'latujnship between the fiiean stud^^nt gainsffind the mean 

• I " ' ' : ^ . ' ' • 

ratings of Pekiip High School teachers. If these items 7, 8, 17, and 18, are 



take^' ou^^^^tlVc_«4^ froni 0.t)7 \.o 0.23 but. nut a^s 

•much as .in.'Ui^CL^ase of. the total sample of teachers^ however. Items 'li ancf • 



' - * ■■ ■ ' \ • 50'. 

16, which are rated high'by Pekin teachers, but j;xot by th*6\ total bample, had high, ' 
-means for student |!)Ost-test scores. ^These items might have been effected by ' * 



special enopha^'es of Pekin teachers. However, the gains for these items were 

not exceptionally. large. ♦ ^ V ^ , ' 

^ ^ ' , • ' ' . , • • ^ 

— 'Thus, low cor relations^^4^-^^neT-a.l-,— AW-hi^h have-bee iWound in the analyses 



between the total teacjien ratings and the student performance seem not tooe 

due to the fact that wq took our teacher Sample f^om a wide ^rea' while takings 

the student sample from- one parti L.ular school. Thereforiiji in the following dis- ^ 

, ' cussion, w.e shall, conside r only tTlc relationships between the ratings Joy the total 

^ grouj>,of teachers and the .b'tucjent pen\ormance. It i^assumed that the Pekin 

* • 

teachers and their students arv good representati'\ es of the total population 

' - » \ » 

^ ' h 1 ' 

u'nder consideration. ' * 

^ It seems worthwhile to look at the. standard de\ iationslof teacher^ ratings 
on itemrs. A high standard deviation indicates that the dispersion of teach^ers' 
. evaluations is liigh and that tne i*te n>stfmifst have some c ontlrove rsial point. A 
low standard devlieition, on the contrary, indicates a high clo^i-'ee of ^y^reement 
'•betweerl teacher evaluations, Fi^ire 5 shows the nelationship between means^ 
J and standa^lKl de^viations of teacher ratings for each item. There is a high neg- 
* ative correlation between means and standard de'viations (|-0.80). Items Z4, 
35, 37 and 4 5 hkve higher means and lower standard devi|itions than^hc otlier 
items. It indicates that most teachers rate thert;^as good ^em^ with a high de- 
^gree of agreement. Ite/ns 17, "18 and ZZ/^^^brs^^the other hah*d, have lower means 
^ and Viigher standard deviations than the other^tVms. Some teachers must have 
rated them as bad items and some must have rited the^ a^ good ones. More 
discussion considering the contents of, these items will be postponed to the next 

/ ' ■■' ■ ' / 

^ • chapter. ^ • * ' , " 

I ! 
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TABLE 8 



>Mea^ns and Stknd'ard Deviations of Pre-te^t, Post-test, 



.ah^'Gain Sco^-^s for Each -Item 



fKl = 154) 



M'eans 



Standard Deviations 



Item 
- Numb ers 

■Test 



l5 

7 • 

" 12 ' 
^ 13 • 

■ - 

• . .16 ■» 

• 19 • 

21 
-22 
' 23 
24' 

25 . 

*V5^M6an 
ove r 

. ' Tie St I 




• * N^n-significai#ly-differcnt from-^ero at the^'5%' level. 
NontsigniOcanilyjiilffereht from zeiro.at^th^ 1% level. 
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52 
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V _f^'Ai%|jp'^ '(Con'tinuedl 



Means 'and Standard Devflitions "of Pre -test/ 
^nd Gain Score's for EacH Itern 

V ■ 



• ."^ IteVn 



ions of Pn 
ys for I 



Post-test, 



Standard Devikiions 



^'VT*Murnbe'r^ Pre -te st- 



Test- 11 

26 - 
27 

" ' 28" 

29 /• ' 

30 ' 



3. 04 
. 66 
2. 62 
■ '.3.6 
•1..47 




Post-te!^' 


Gain 


Pre-itest 


1^ 


r^est 




' Ga^n 


... ■ 3: 


64 ' 


\ 


60 • 




7 


.65, 


* 


1 .,09 




75 


2.. 


08 


- 1 . 2*6 


• 1 


. 45 ' 




1 .^1 


. ■ 3. 


01 - 




39 


• . 90 




. 77 




•i. 09 


- 1 . 


•56 . 


>- 1. 


20 


• 65 




.93 




1.13 


2. 


01 




55 


1 ; 1 3 ■ 


'i 


. 22 




1.^2 


-. 1 . 


43 


. 1. 


36 ■ 




. 1 


. 32 • 




- 1. 34 


- 1 . 


75 




65 






.93 




1.16- 


2. 


23' 


1 . 


03 


• . .9> 


1 


. 23 




1. 36 




^^4 




30 


• . 19 




•U 




. 72 


3. 


27 ' 


1 . 


06 


1 . 27 .' 




.9^ 




30 


3. 


79, • 




42. 


• .8j6 ■ 




. d4 




^: 9.0 


. 2. 


76 ~ 


1 . 


26' 


1.06 ' 


1 


.13. 




'1.32 


' -2. 


96 




88 


1. 39 


1 


. 40 






3. 


6& 


1. 


.01 


1.18' 




. 6L , 






. 2. 


91 


h 


.93/- 


1. 10 




. IE 




l.jn 



3. 85 
2.'M 
3., 02'' 

2. 39 

3. 01 
5. 01 
2.7J> 
3. 41 ' , 

1 . 62 • 

2. 31 



51 

52 

53- 

54 



2. 16 
. 53 
.92 

1.01 



. 1'4 

1 . 44 
1.78 

2. 03 



. 57 
1. 06. 

. 54 ^ 
1. 22 

.51 
1 . 64 
1.-30 

. 62 
1.04 

.98 
^ . 92 
.86 
1. 02 



. 51 
1 . iO 

1.06 
. 98 
-1. 05 
1 . 26 
1. 63 
.82 
.72 

1. 4*3 
. 72 

1 . r9" 

1 . 40 



'.47 
1.23 
1 . 06 
.1 . 04 
. 97 
.84 • 
r. 12 
1.15. 
.85 

B '•■ 
.^11 
1 . 42-. 
' 1.73, 



, 70 
,1^ 47 
1 .'l^' 
1. 38 
1 >27 
1. 18 
1.'44 
1.69 
1.69 
1. 38 



f-.^3 
1-.66 



Mean 
ove^ 

Test II 

Grand - 
Mean 



1. 64 



1,. 79- 



2. 57' 



'Z. 68 



. 94, 



7? j'l ' 

• .90 
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/ Inter^orrelations among Test Items' ^ 

Intercorrelations of Student Scores among TesXItems ' ^ > • 

Tables I, II and III in Appendix A show the cor relation coefficie^'nts of ' - 

% ---^ ' - ' • ^' , ' * L ' . 

students^-pre-test, post- test, and gain score-s^ respectively, among the itemsT ' 

Ger^rally ^peaking, the degree of corr eiatioi}s among items is relatively 1o\y 

in^U three cases. The cor relations which are significantly 'different from 

zero at the 5% level underline?! in the tables so as to make it more con- 

' *> ' ^ . 

venient to find out which items have rela^j^vely high correlations with each other. 

• - ^ ^ . ^ J 

Comparing the correlations in the cases of pre-test, post-test, and gai^ 

— — - ' ^ ' • t / ^ 

- — — _ ^ ' • ' *• 

scores, the correlations in the pre-test case are generally lower than those in 

the post-test case, as was expected.^ The cor relation§i'of gain scoive's, ho\yever, 

tend to be the lowest of the 'three cases. * 

^ / ^ . • - ^ ' 

In c<:>mparing Test 1% with Test 11,^ it is obvious that tlie correlations among 

* t . • ' 

T^JLLcitficaJA^-ca^ to be higher than t*hoS among Test I items in the 'post- . 

test case, but this tendency is not evident ija the eases of pre-t^st and gai'n scores 

Inter correlations o:C-Teacher Ratings ^among Test Items - 
Table lY in Appendix A shoves the correlation coefficient's oi!^teacher ^ 

♦ \ ^ • ■ - V. . •: 

ratings on the test items. In generaj, the- deg'ree of correlation among items is 
larger than in any'.of the three cases of studient correlations. In this table^ the 

• ^ ' * , , . . ^ ' ; . • . ^ 

correlations which are non-si 
s 

underlined inste^^d of the significant 



gsifit^antly differenf frpm at the 5% level <±re ' 

[ficant^ones. The cor\elati6n'*^oefficients* ampng 



/the items within Test 11' tend to lie higher than th^e <^oef Jicients within-^Test I^j' 

The fact that correlation db^ficients among items within Test I are' lower than 

those yvi thin Test ll ind^ates that the'^Tnilarity *of TestMI .items isT^^rger tha^n 

that of Tjest^r itenfis wT^^respect to the teacTiers' lutings, A sifnilar relation ' * 

\ * ' * . * • ^' 

'has be^sefen for the ppst'-lfest scores of student data^ The^e^^e suits suggest 



V**. - • ^ ■ - ^ , • ' 

- - • ' • ■ ' ' ! ■ • • ' I . ' ^ ' 63 

• that the items of-Test II are seen by teachers as more cloiely*r elated to the 
curriculum in the text than Test I item's. , In fact, as seen in Table. 3, 'Test II 
items have .been construe te*d so as to be closer t-o the text thal\ Test I items. 

•* * ' ^ * 

3. Factor Analysis o£ .Inte'rcorrelaticJns . ' • 

Each o*£ the„ four kindb of,intercorx:elation matrices shov/n Tables- I, II, 
ill, and IV 6f "Appendix A was lector' analyzed by the principal comjsbnent ^ 
method, with unit va^riaftces inserted' in the diagonads, Thfee factors 'were ex- 
tracted from th^ 'cor relation matrix ambng.prc- te^t items. Two factors were 
extracted frbm^each of the correlation matrices among post->^e.st'itemsu and 

■ . . ^' • * ' - - .- * ^ ^. * • 

among the gain^. Finally, factors were extracted' frOm the .correlation 

' matrix among teacher rating^s. ' TKes.e numbers of fa^rtors corresponcj^to sharp' 

• ". V I . ' ■• ■ \- ■ ■ ' ' ■ 

breakSxin the piotS'of ^oot bi^e versus root number for the student pre-test, 
post- test and teachers' rating d^ta. ^he, decision for the gains score was mord* . 

. ^ ' . ' ' ■ ' - • ■ , T 

equuvic^i. i ; \ • • ; , 

Let F^, F^, *T.^, ^nd F^^ be normalized la»tent vectors of R^, R^, R^,, and 
R^, .respecti^e^ly, whete R,, R^, R^. and R^^ denote ]the inte>C<jrrelation mat- 
races -among itemb for student pre-.!ei5t, , post- test, gains, and teacher ratinj^^, , 
respectively. Let , be a diagonal matrix-cor^sis\ing .of the Ji r st Ahree largest 
latent. roots of , l-^^oi and L^ ' be diagonal matrices consisted of the first ^ 
two largest latent roots of R,.^ and R^, -.jespt^cti vely, and finally' L-^^ be a , 

-^diagonal matrix consisting bfliie first five large st*laten^^oots of R4.^ If we ^ 

^- . • ' . " • «. ^ . I* ^ 

let A^, A^, A3 arjd.A^^be the principal factor coefficients for each''R,^ ,they 

, ' ; . * ' ' . - * 

* are given* by the' equations, A^ - F^L^, = -^3 ^ ^3^3^.^^^ \^ * 

I A: F^ L^" and the results are 'shownan Talilesrl4* and 15.^ ^ • 

: As can ^e seen in the bottpm row of these tables, the first Isytent roots for ^ 

' th'e* teacher* ratings. and th^* student post-test performance are the largest, of all 

" ^ * ' • ' • / ^ " * ' ' ^ 

the iatent*roots,; This irDpli.es Ithat the fir^st principaf factor of the teacher 
- » - * \ , 



rating-s account^^'for the largest part of the variance in teacher ratings and also 
the liv^t principal^factor of the student post-test performance accounts for the 
large st^par t , of the variance ^^^^^ studea^.post-,test scores items, ^^jj^ther 
factors are less domi^feannhan these two factors. The ^niagnitude of the latent 
root, then, indicates the degree of the importance of the factor. 

The sum of the latent roots, however, is small for a^ny of the student data ^ 
with ro^spect to» the^. total variance. The sum of the thr ee^larges t latent roots for 
the student pre- test is t0.704-an^it accounts for only 19.8% of th^ total vari- 

"^nce. FcjT'^the student post-test, tije, sum of the first t\Vo largest. tatent roo'ts^ 
isMO. 619 and it accfounts for 19,7% of the total varianc'e,: For the student 

^ gain scores, the sum is 5.849, 10.8% of *the*4:otal .variance.' The remainder of 

.* totalc variance seems to have no particular common factoVs. ,It is the sum o£ 
, the uniquenesses for thh ite^^* which include^ urtreliability or errar. These low . 
*communalities may result from^h^ fac«t ^hat each i*tem correlated was composea 
of no jnoreAthan four sub-items. For the teacher ratings, however, t*he suri>>of 
the first five largest latent roots considered as comrrton factor's is 33. 195, and 

^ it accounts fwv61. 5% of the total vafiance of teacher, rati^fgs? 

The" similarities of. the principal factor coefficients foTr the itemS at pre- * 
test, post-test, anti from the gainifecores, with the^ principal factor coefficients 
of teacheir ratings are given by the matri*ces *F^F^, F^^T ^y^SiXid F3F^.respec- ^ 

' tively,/ They are showntin Tarbl^e 16, where each cell of atmatrix ihclu'des an 
element of ,F[F^, T^^f^,, Or F^F^, The First principal factor of tl}e teacher*: 



^'ratings^ha!s v^he largest similarity with the first factor o.f -each of the tnge^ J^i'^ds 
I of student data. The 'degree of •similarity is largest for the post-test (,92^1), 
* second largest for the pre,-test (, 8785) and least tor the gain scores^ (, S659)^y._-i^. 



Since the variance of each item is standar'dized, the toial" variance is** 
identical with 'the nuiliber of items, 54;"^* ^ • , ' • ' 



It seems interesting that the second factor s» for- both pre-teS't and post-test scores* 
ha^il relatively large sifenila^tieS with the fifth (actor for tW tkacher ratings, ,v *, ^, 
aitl)ough these' sirpilaritics artjlnot significant. " For the ga^n sjc6i;e5'*, the second 

^..3 ' ' ■ ' ' \ ■ ^ • ■ . ■ ■ ' J-^ \: ^ ^ 

factor does not haVe a bariicularly large s!*imilarity with any fector for J^acher ^ 
* ratings . ' * • - - • 

T ^ 4- • • ^ . .. : ^ . • 

In cfrder to determine the congruentlspace ov^r. student performance and. 
tea^ftfer-' ratinrgs, .factor matchipgs were tarried out foh each of the three ^in^s^ of • ^ ^ « 
y^stud.ent.s,Cpres with th^, teacher ratings, by the method discussed in*Chapter II. 

\ computed^. Their latent r.ools A A^3 anS the associate<J unitjatenl 

.Ve^lisi V^, y.g and .ar.e determined. '0^^'^^ ^ ^(F^ F^) '(F^ F^) , G^^^) = ^ *\J 
^4^'^^2^4l» ^.^^ ^4(3) *^^^4^'^^a^4^ are also computed, and^the equiva^ • H 
lencV of th^ir ,positive-distrnc t latent root's with A^^^., . A^^/- S-nd^A^, found in th'e^ 
^'preced4i5|| GorhJ>utati5ns-, are* c?|e^cked The unif'T^'ent Vectors V^^^^ for Ct^q^ 

'V^^2)'^^^ G^^2)> {^.) -^4(3) are determined. These ^results, are . , 7 

1 summarized iti Tahle> 17' and 18. * - * - / *• • * * 

tS normaiized factor (i^o^ficients o^ the matched factors for student pe^- 

iting 

^■=^5;iXi and B;.„^ - .f/v,,* ... ? F^y-^ ^"^^'^M-zj =' ^4^/2) also^give 

the normalized factoi" coefficients of^th^^^matchetf factor s for^ student performance 
in pbstTtestis- arui tliose fo^ tl^acher Vatii>g^. = ^^'^3 ^"^(3) ~ ^^^"^(3) 

*are,fpr ^tuj^ent gains and foV leSchor ratings, respectively. Each of the matched a 
factors will be denoted.by lower-case Roman numerals i^ , ii,, ii^/,v, 
etc' 3ubs<:ri^V7vl J 'Z,*3,. and ^'''denote the pVe-test, post- , ^alns and the 
. ' ^ ^ teaclter *ra1ir\gs,' re^ectively. , i^ demotes, ^ for example? thie fir st mtatched f alitor 
*for studen^^*^Qrj^or»nrlanoe on pre- tests with teacher rattngs", and 14 denotes 
. the /firs^ matched^fact(()fi;^ teacher ratings^ with .studenf^^form a nc e o^ jpVeTte^ts ' 
- St) fprthr They are. griven^in Tables',!*?,' 20 and 21. 6» • 4^!' . • • ' . 



A fo'rmanco oq pr-e-le^^Ts and thd,se for .teacher ratings are? given by. computir 
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■ ./The values H;,^) =. ^i^4(i). H^4(2) ^ 'B.B.^^) arid H3,(3^^ -^l^i^^ . 

give the coefficients of congruence (op matched factors of the teacher r(^^^^- 
with the student performance in pre- test, post- test and the gains ^s^ecti^^y, , 

and they are shown at each bottom of Tables 1-9, 20 and 21.^ The coefficients of 

: \ . • * * . . ^ ^, ' ' 4f ' . * 

congruence H, ./,v, vH^..^., and Ho^/V\ identical with the square roots of 

theiatent roots A-.^^/for^ G^'j^, A^^^. for G^^^, and A^g /or Ggg^ respectively, 

' K*is interesting 'th||f the transformation matrijL^\^Ji^^able , 18 is^tHe 

-c^ Identity ijiatrix which means th^ the principal factors for the student perfortn- 

ance ii>-post- tests are the«ms*Lves rA^ximumly congruent with the teacher ratings. 

A, similar ^^tend^ncy fioWs for the student pr^-test case. ^The frteiih diagoiial ^le- 

^ ments of the transformation roatrix V. are'approximately one,* and the off- 

dftigonal etemer^s are upp^:pximately zero. Hence, thj^ transformation matrix^ 

XB approxirrrately the identity matrix, , in oth^ W)rdl*, the prfhcipal factors 

for the,studeht pre-jest are. ^eignselv^es almost maximumly congruent with th^ 

teacher ratings. Tl^stendency is not strong for the student gains. /In-order to 

^^ach the congruent axes, 'the principal ^xes have to be rotated about +21^ and « ^ 

t^e second axis has, to be reflected. For the transfo^-mation Vnatrices* for teactter 

ratings, ^4(2)' ^^^^4(3)' should be noticed that th^ first principal^ 

factor is, )m every case, the factor mosFclosely related to*the first matched / , 
• ^ I ' ' . • ^ ^ * ^ % • 

* factors'. This is true 'because the direction cosines of the axes between 1^ ah4 ' • 
i. are greater than 95 and dominant in each case. , , ' ^ ' 

^ 1^ ■ ■ " ' ■ • . 

As seen in Tables 19 and 20, .the. fir st .matched factor for the pcrst- test h^s 
the^ighest coefficient of cojieruence with the first matched\factor for the t^ach^r 

• ' • .* - ■ ■ ' ; ' ■ 

ratings 94|), j.arid the first matched factor for, the p¥e-te"st has the secend ' 



4 



highe^'C.oeJflicient v/ith the first^ud-tched factor (or the teacher ratings ^930) . , 
-^hre resji»-of the 'factors for fetudent^^ei^fdrmance have smaller xpefficients with 
*the facto*rs*£or teacher ratings. ' The first matched fac tor for gain scores has 

'• ■ ■•A ■ \ ^ . ■ - 
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•■ . . -'67 



.652 as th'e coefficnient pf congruence with the tirbt, factor for th^ teacher ratings^ 
whicn woul-d be considered significant, byt not highly so. In thj^ first s:tage of ' 
this study, the highest epngiilft' n<. t uas hypothesised for student gains wlt+i teacher^ 
ratings., the s'econd-for past-test and the lasb Wr'^pr^-test. I^his hyp(^h65.^s( was 
not verifiedijfor student gains v. ith teacher ratings, altho^ugh the coefficient of 



congruence was. higher for the -pust- te st than tor the prc-test as was h^p^pthesized. 

- - . # . - • " - , • 

. 'Jjj hti minimum v alue a t-^gre coefficient of .congrut;nc^ such llial Lwo factors 

are regarded'a-s meaning*;\ill^ t.bngrueri't may be chosen, more or less, dn an 

arbitrary basis as in the case of setting the mintniunl correlation coe ffieHlnt b/ 

which two variables ^'.oald be regarded as highly correlated. If taken, as - 

the minimum coeifieienf, ^in such a sense, the second faetK>rs for student scores 
. ; p ^, ' 

and teacher ratings \\ill not be regarded as c^gruent in nil the three case.*?. If 

.50'is taken as the '"mi-nimuni mcaningtuf oelficient/ the sec o/id factor 'for the^r^;] 
« ' -J. ' • 

post-^stwit^ the te^aC he r, ra ti ngs %m11 be regarded as melL.ning fully cpngruent? • 

, • \, ^ *^ • 

/ 'It .40 is "taken, the seco^d^j^ac tur tbr^the studei^t garins and^he teachq^r ratings 

^.are regarded as coriiiruen-X tOr all tht^ {i.rt e i ast s*, bul^'this criterion seeii'^ too 

small fQ#'ax:oeiiinent ui ^neaningfuiiy c-ongrirent factors.^ The \arianco acr<2,Unte.d 

* f o r by a c ojt- 1 1 i e i t- 1 1 t^f . t h i s vs i z e i <j ni y . l-b . , * ' ' ^ 

' In order tu .!5et the reLttii>fi4hips bt tv, ec nwnal he ci*-la< tor' c oef f icie nts visually, 

' thfe- pairs 



lines as 



s of thtJ'first aor*n)al^Z( d t ongru^nt faUor oeffi ci'e nts arc ^jnnec ted with 
^hown in Figures ,r>A, f.B, and' LC. In other worddl the |''s "o^'the 



v'aiu^s of the^oiumns i,^*^ arvd i^ in Ta^fele 19 are- plotted on the vcrtU^Uy 



' pamilel linei?, and the nuintb tokr oac.h pair of valut.*s are c on/icc Led as in Figure 
,6A,x T^*§ame type of grclb^];)}i,^^- ma'de for the pair.s pi the value> of the columns 
. -i' a.nd 1^ in Table ZO, and^or those of i^v>\ an'd i./ in Table 21. which are 
given in ^igute 6B and 6C, respectively, II' the two factor coetficients matched, 
are identical with each other, .all the iihes connecting ttrem -^^^ould be horizof^tal 



and p9,ra.llel. For the case of the post-^est?, which has the. highest coefficient 

' ! ' ' — ^ * \ ' ^ * . 

of congrtl^nce (.941), the' lines lie most- nearly .together and' horizontal, and the _ 

factor c^oefficients for the item^ are* less scattered (Figure 6B). For the case 
^-'"^ ' * • • ^ • • 

of the. pr^-J;e St which has the^ second highest coefficient of"*cangr uen^ (,93-0), ■ 

, • . • . ' ^ ^ ' \ * ' • 

the lin.es' ^re moTQ diverging/ In particular, the factor coeffici^ms for the sttu- 

dent performaiice diverge nr^qre than those for tire teachei* ratings/ This tendency 

is more evident for th^:'abe 6f the student 'g^ins v»ith the- teaofiCr ratings in w?iic-h 

'the c oefficient^pf congruence is i. 6>2. (See Figune 6<3. ) The factor coefficients 

tor the ^ains scatter di^^^^el^y wl^l^-^e factor co*eff\<:rient& for the teacher . 

ratings <\o not.. . ' * 

.' • ' • - * 

For The maturing of the sec6nd factors, tHe highest coefficient of congruence 

♦ * ^ \ ^ 

is sfeen for ^the, second factor of the student post- test with th^ teacher* ratings arr4 
it is 51Z. Figu-re 6'D shows the factor reiat*ion«hips . However,* a consistei^t^ 
pattern'as seen in the cases of the first factors se^ms to have disappeared in 

■ ^ • N * ■ ^ .^r ■ 

this case, (inrfthi s* basis', the'second matched factors are then corjsider^d^to be 
^ * ' ^ f . ' " 

. / . ^ ^ ^ . . • • 

ngn-congruent with e|^h other for all three vases of>st^aent pentor-manc'e . In 

* ' ' • • . r / •/ \ ' ' ' ' ^ . ■ 

"the followirig ^isc us^^ion," therefore, , only th^ fix* st* facf tons matched will be con- 

.sidered^as candidate's for the congnuent fac^tors. ivls.O/ a's 'a .consequence of the »' 



disappointing '•results for the g4inb sc6rts»xorre?^tions, ncr fur thep- consider a^on 
' * * * * ' . i • / t i * • * 

,wlU^Jfc>J^ giv.en to- th*e -factor analysis pf these gains- s/cores. ^ ^^ 



The, Siagrams for the r>-»e- test and-the gain cases are nof shown bere^ but. ^-^^ 
they/lc^k more randdpf than in the post-tes^t^ase:' . * ' * . * r ^ 



f -/TABL^ I 



Principal Factor CfQeMcienW of. Studerit Test^ 



*Pre,^test 
Factqrs (A, ) 



Item * 
Numbers 



II, 



III. 



Tesn- 

1 

2 
3^ 

.1 4 

• S 

• 6 
7 
8 

■ 9- 
10 

• 

" 12- 

'13 

44 
^ 15 
. 16. 

17 

1&: 

19- . 
20 



0 



- 21 
22 
23 

\M 
25 



234 -1881 ■. 22f 
3Q2 -138 069" 
•299 -312 -338 
, 310 .--032 -S^2 
5233 , 075 '7073 
-'095 - 058 .211 
139- 182 ■ -560 
141 263 463 
143 , 082 168 ' 
• 165.. -21-9.^10', 

IHO -054 404 
np -386. 189 
036 117 -070 ' 
05^* -157 -095- 
033s .-232 0.63 
134 ^ -282 .. iiO. ' 
039 •* •096" 4'35' 
36-4 462 
116 ->6"4- 
291 -213- 



-.075 



' 322 
■ '343 ■ 
'/319. 
3'99 
142. 



092 0-62 ' 
.459 -031 • 

480 (M3 
•*324 .'-1-43 ^' 

209 ' 130 



# -'^os^test ■ • 
>/' Factors (A^) 




. 3 ,51 
» 24^ 
12.9 



'20^ 
-0 57 
-^210 
.^308 
n3I 
j 060 



II. 



, •(J64 . \o 



-331 
-J 10 
-270 



.087. 



03 5 .* 




190 

■246 -023 
H.-292 .116 
if4 I. 115 
|-6- -043 
'-0,65.'. 181 
' 314 -037 , 
414 -130 
■ 168 025 
-133 139 



-0,44 
074 

■ 17 9 
291 
-051 
-090 
•315 
500 

248 

-001 

-326 
268, 
256- 
276 

■m 
/ 



-03^. 
,031- 
-1^ 
-235 
-268 
^24 
017 
-139 
043 
246. 

273 
■ 34'7-. 
133 
398 
'-006 



^Decimal points -are omitted-f 



» 



mcr. 



■• " . tABLn 'W( continued) ' " . ' ' 
Pnncipal Fac.toi^ Coefficients p/Student Tests 



Hre^test * . ••Po^t-lest r'lains 



Item. 



Kac«^rs-^{A^) , ^ 'r.Faqfors ('A^)^. . i actors (A^) 



.Numbers'. I" II; lU * I';* -'11, ' ^ Ii: 



2o 3.^1 -0-34 -04^; " t 543'' -OoO -077, '138 

, , 477 -0Q4 -d84 / 4 477^. '-108;, ' 08o. 1Z?> 

Z8 1Q3 -007/- ' ■ 44Z'--3S1 - -147 :^44 

, 1^. r lir »17^ ..313 ' ^1^>8 ' - ! 337 -28^ 

/3a - 4:'3 ^-^08 '1504*- ^Oilv' 1*^*3 ''3Z?- 



, . -31 . 0< 4 01<' --ilZ , '-^"^r"" -OoO 433- 1 10 

.' * 'i^ • ■ ^Zc=- -Zof -^30^^' ' 544 "*'-li7 ■^40 -165* 

^34 , -00"-* -04c 1»'^ " : 44? -ItfO ' 4oO • rl91 

35 • '048.. -373 it;o^. ^ ' DOT -l6l ' -13i -lfif9' •• 

3.6 • " 407> -U'i 1-^4 • ■ : "4-31 104 , " 019 , GTQ 

37 HP*- «^341 ^ . oO^ -117 '. -0,45 -/3i- 

.38 ' ■3:z -335* T^iLj'' ' ' j^O . -Oeo . -if-l. . ^035 

«• -39, ./ ■/'^4i3 -Of^- 00'- - 5oj .-08"^ "^"#0 -097 

4Q' ' •307' -Z-**^ -05'^" ■ =>f4 -08-3 ► ' 18Q O^o' 

' . • ,y ■ ■ 

4X ■ " -ip4 --O'.l, ' 1,7,- » Tfl -043 •-004-' 

, ^isi. . .. 51-3 -^37 144. ^J^-,. J4'H * OOB ■ '114 

43 <» 4oZ ' -404 1 34 * O09 • 0i4'.- '. 289 13-5 

44 '329 '-01-B. -0 5Z- S*30 Oil' ' .; lit 13^ 

45 . /3Q9 ■ 031 -2oZ . S50 , 13! . '• 1 =. U ." , 1 3 ^ 
■'■04ii -0=>t) ' >17 -.174 ■ • -000 270^- 

47 481/ /03 -3 11 587 13:5 \_ ' .438 \ 

• 48 ' . ; 449, 43<^, - 500 • .^o- . -^i^ ■' 'Ai8 ' hU ' 

49 , 307..- -099 . t)p7 ' ' ^ 343 Zib ,, 033. ' ,107 

, ' 43^0. ' 1 5 * 458 ' ^. "bOl o?pl 1 '> - '440 -14^^ • 

51 <. 394 ^-4'14 OHl." ' 363| ' 5QK' ' 399^ -070\ 
•54 * '. "358 41 5 -t4£ • 514 35^ _^ " . ' ?73 . -1S4 

53 • 147 ■•'3\8.i#t>b, 415 ■- 590- ; '.234 ' -4ob-- 

154 .r, - ^411 3^7 ^39' , ;' 444.. 550,'.. it? -4,94 



« 



7. 



♦ Latent- , 'J. - •• 1 • ;■■ / ■■, ^ . 

Rdots ■•■■■-r-.f/SbO 3. 1.44*7VT00 8.041 4. 578 - . ■ -3 . 430 -4.619 



> I I ' f . ft. 



,Prineipal Factor Coefficient's of ^Teacher Ra^tin^s . 



/ 



. ;':Iterri 
plumber s ^ 



Rating Fa-clor s , (A^) ^ 



4 



m 



IV 



4,. 



Tefet I 

" 1 -> 
2 

3 

-4 

5" 

6' 

7 

8' 
' 9 

• 10 

* 11 

12 

-^1^- - 

'•14. 

■ ih 

18 • 

1.9 
20. 

' i\ \ 

2i , 
25- 

24 ' 

•- -9 - 



409 

=^80 ■ 
.704 

•7,00 

4Q7 

43q 

73K 

.'418 
417 

^^oOi 
408 
340 
(.03 

40i 

Q 



-3<^6 



292 



n4=, - - ^ .^07 e 

. -222- 
- 17 . 
-20^1- 
248 
-331- 




.57 0 



116 
21b . 
-2 59- 
'-30.1 ' 
■•'1 7 1 
. l&b . 

5^7 

■ 1 3»0 

'"t)7 0 
. '.43 

I 37 

281 

7 00 . 

7'87 . - 
., 217' 
•21- . 

144 ^ 



' .>-3ir 

^ --024 
-087 

' -144 

ml 

• . »-e5i 

.070 

-2A'b 

X)2o 
\ '. '528 



■ S44 

. - 1 1 3., 
^ 4uJE 



-Dt;cim'al pOin'ts^ari- on.itt'eci 



-187 
. 'I 306 
•• ' 428 - 
• ' ■ '047 
2^0- 
• -036, 
;■• ' 22S 
-2bo • 
. - 1 41 

r --r84 

, ■ ''-jl4 
-140 

114 
■'518. 

,-o-4r'-. 

-l08O • 
080 

ois^ 
• ' -ofs' ■ 

. ' / -032'^ 
, 207 . 
-, \084 



-321 
' 051 
415 
■ 274 
0,f)5 
446 
27 1 
23^ 
- 216 
,.152 

019 

-195' 
-080 
. 'j24& 

''^282 
-090 
-062 
-.64'3 ■ 

.-"124 



/ 



.. r., • 




■/ 
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^ » TABUE '{C ontHftufti) 

Principal Factor Cd^ffici«rifts'o£ Teacher Ratings 



72^ 



.Iten) - 

Nurpbers 



Te^t U 
— n.T 



'28 

- 29 
30 



7iJ 



Rating Fn'ctors^ (A^ ' 



III 




-ObO . 
'^OOn 

-OTcf 

d-r 



0'07 

246 
231 
401 



-310' ' 
-270 
-094" 
-228-/r ^ 
-129 ■ 



•31 : 

32. 5 
•33. ■ 

34 \. 

35 

3b 
.-37 

38 

39 
.40- 



-1, < 



41. 

. • 43 

. 

. • -45 

46 

. 47 

'• ■ 48 
• ■ 49 

-.50 

. *. 52 

53- 

: •. -54 



o2b 
o«7 



740 * 

* « 

70 1 

70'^^' 

j<0 2 r 



^6^ ■ 
7_=>r, ; 7 

691 ■ 
-ol4 

''b34 

• Tt.Q 

-^8 38. 
7-9 B 
486 
b'l3 



- J7 4 

- 121 
^-2'o8 

-67o 
■ -O^Z 

•. - ^^^ 

lb8 
. »t)2 3* 
-014' 



- 147 - 


- i <^ 


- 108 -'. 


.-.^ - 3.0.^' 




; ; -.h.3. 


'. -'Ibs ■ ■ 




-21 1- 


^ -op 


-24=. v 


' , 170 


-07 1* 


'09 3, 


-28- 


' ■ ibi 


' -242 _ 


. ..-io^ 


--2i)9 " 


•' 17'2 


f 




-088 ' 


/ '^26,1 


■ -do6 . 


; -lb4 



230' r 
-047. 



: / 3bQ 

o'bi- 

■ • . 5 



50b ' 
123 • , 
349* 
,27 1 '• 
-27 2 ' 
-22^ 
--1^1 >21 
-OpO 
-184 
-17 i . 



-44.^ 
. ',218 ■ 

■ -ro=r 

. ■ »-2-68' 
' -.l=x3- 
• -"■ -204' 
. .-383' ' 
.4 -242 *• 
. = 1-53 ■ 
" M98 



.-115 
-293 
--128 
^ CW7" / 

-a 39 
„.=_L27'^ 
• 170 
-040'' . 
■ -0«>b 



'J vol 3 

■¥r-oii 

- . -03b 
■ -0-5 9; 



M ■ : 

094 .* ■ . , 
.05'^ • >.«■ • 

.- i «r4 , . ■ - 

- 107 ' . 
•297..'M' • 

292 

159 . ^' • - 

• 122<> - 

•072 

I6b * . 

-r2'39 •• • - , 

• 34 r- : - 



L/atent ■ 
Roots 



20:'770' 



4,-594 



^ . 5bil ■ ■? 



••.■_"'2.241 



■■^l. 026. 



. ft 



± 
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TABLE 16 



1 Principal- Factor '&milari't'ies, between 
Studen.t Perfortnlrice and Teact^er Ratings' 



.7*3 



i ^ Student * ' 
i ' Performance 


* * 4 










. ^Pr^-test (rp^" 






••■ ,8785*. 


I73i! 




'-.02 34 


.... 1423 




'.Z089 '\ 


■ .2'093 



IV 



4. 



4. 



.1554 



-..OPS 5 
'. 0002 



. 0328 , 
• . 3900 



. 2'093 y • -...^OboO^.^-. - . 0980 -,..0379 



Post- test- (F^) 
— 



.J 



Cains (•F'i) 
3 



"2^ 



I. 



II. 



-.•9^81' 



,..5659. 

..209^ 
•J 



-.080i * ' ;.0347> -. 040'9- 



-.'iSoO 



.■l9fl 



. 2266, 



,. 06G6 

.0208 
. 42980 



- . 2^92 

.^0978 , 
- ; 148i 



( 

/ 



^4 



. 0447 
. 1180 



Ro:^fc|xiurneraJs indicate the princip^Tl factors, Arabic subscripts A 
'ind^^'the kind of data fifom which thq factors were obtained. 



1 ^ 



4/ 



^^^^^^^^^^ t ^ * 



1^ 



'it 



'9i 



■ \ 



- .J 



•TABLE 17 



T Cros^s-jprodut ts of the Principal- Factor SimilkrTtfcd 



^ Pre-U*st over 
< Teacher Ratings > 



11 



■ II. 



- I . 8370 ■ . 004 3 ' ; 1454 ' 

II: .00-4 3 .22«5 -.0053 

III/ . 14 54 -.0*0^3 . lt)27 
1 



' I 8160 
II, -./123 
_'m! .1174 



' .Teacher' Ratings ' - 
over P-re-te.st 



II 



•IV 



V 



IV 



.-1 



V 



.;io\d 

■. 01 IT 



-.1123 
. 0942 
-\0d71 
-.\0O33 
. 04"! 8 



.11*74 -..1070^ .0119 
. 0071 • - . 0033 ' '.0418 
.6840 -.0089 ;0996- 
■.0089 •..019-3 .0005, 
. 0996 . . 0005 . i 54 6 



)■ 



•; ' . ■ ■ ' s ■ 

Post- le si ov-er 
' Teacher Ratings 

V^22i*£^1^4^-<^r^'' 



■ "2 



J 



.'884 9 
. iD'004 



,0004 . , 
. 2626^ 



\- Gdins'over 
' e a t" h e r •^'a^uig s 

■^33 - ^^Bfti'^n^"^) 



/ 



II 



S 



I . -.3711 
- ,,,0710 





. 0710 

. 220.1 



Tti^achcr Ratings ^ ' 
o\ e r Po^t-test, 



■ 11^ .„ 



'III. 



- 1.- 

iiil 



. 862 3' 
•.0799 
.,0 50 5 

04 4.8 
0983 




-'.0799 .OlO-i -..0448 ' -/tm-3» ' 
.Q410 .0085 '..04^^^.0674/ 
'. d08S. .004*^ .0124 *j.029r' ' 
. 04 =^9 . 0 1 24. 0=^4-2 '/j'0899 

- . 067.4' - .,02911'' - .,b*899 > ; .,.1854 



r i-.aV h< p Rati rtg.s 

ox c r- Gains 
Q I v-r I.- \rtirr 

A Li) 




: "^4 



V 



iiii 



IV 



V 



,4' 



^ 364 3 
. 063L9 
'. A74 2 
'fO'24 5 
.\501 



'.0639. .'0742 ■.'024 3' 



0501-" 



■'iq<902 '-.0635 '. 0529 ^.'O-l^O-' 
-.0635> .,089^ '.-.,0421.* .03.61 

.0529 -.'04'21 , ;Q315' -.■Oh3l " 
-.0480 .0361 '^-.'OljSl -.OU^' 



7S • , 



( 



T/\BLE 18 



Transi'ornuilion Malru t-b' riiurLa,4.unt Root 



. P.ri'-test 
V, 



ii 



1 



> . , 

111- 



«1 .9823 '-.0023 
Ii; 0050 .9992 
mf-\^'l874 -.0390- 



1875 ' 

0387 

98i5 



II 



Pofet-ti-ol 

■ V . 



I 1.000, 

. ooo' 



0006 



1 1 



1. . 929b . ^t^^^ 
11^ ~368.5 -. 92 96* 



Teacher Ratings 
V ' 



1^. - 



.i 
II 




(1) 



'"4(1) . 
■ ( 



'^Etathtr Rri tings 



97^0' -.0^14 .14.42 I, '.9807- .0^6^ 

.1407 ,2.793 8.909 -lit - . 0853 /- . 36'29 



.:< , '^^^ III' ^ 1522 .4988 -.'3008 III" 
• ' IV'^ '-■.JVZ\& ' . 0-078 '•-»i8 3f -IV, 



'V" .0292 .-8181 -.i0 36 
6 . - V .. 



lont 



JUai 
** ' -of 

Matrix c; 



^aots 



I 1 



,B(jAS /*oooo" oooo,* 

. 000.0 . 0000" . 07^] 7 ' 



• V 



,4 



. 0368 -.'-1 181 \, 
--.04 37 - . 4n 7 2 ■ 
-,-1263;; .-80.09 ' 

Lsife'Ax roots 
Matri*. i't , , ' 



, 1 Cf/u hi r Ratings 

I '. 9550 .. |3||f . 
ir . 1576 ..5bt7 

^ir 204-2 -: lU-.'' 

ivi .0575 .,3967 • 
.134-7 -.■>13t)<>f 



•9 



I't-nt.' rxjot !- 
• _ol . 
M a nix 



J- 




V 



■A- 



9j J 



» ^ . ■ - s 



76' 



TAILE 19 



Nbrrrialized^Congruent-ifcactar Coefficients for 



TtMc'her Rtitings.and StuHont,|Prc-l(;st P^e r for mane e 
, , Teacher - ^ ^ Student 



]^ • . Ratings * ^ • Pi: test- 



:kems * i4(i) ii!i(i) 'i"4(l) ' ' '\ '^'i - "^1. ^ 



• 


Tes^ 
1 


- 

126 


-1 56' 


7 144. 






1 33. 


0O8 


, 081 






068 


■ 1 90 


01^ 


% 




065 


. ' 1 34 


0.35 




,5 ■ 


148 


-04 3" , 


-067 




• 6 


1 03 


' 279 






7 


1 20 


081 


134, 




8 


, . 092 


067 


08.1 




• ■ 9 


096 


177 


268 




10. 


0^}5 


130 


. 27.6 




y ' ; • 
11 ■ 


153 


-022- 


134 




12 


.101* 


-032 , 


211 




^3 » 


036 


-038' 


'3'67 




14 


033 


-02^ 


270- 




15 


"082 


-1 1 f 


020 


ft 


. 1^ 


116 


-070 


100 




11 ■ 


04.6 


018 


34 5 . 


t 


•18- • ■ 


02-5 


06,9 . 


• 34 6- 




. 19 . - 


163 


135 


043 




"-'20 


1-42. 


. 115 


-001 



1 , 



130 -ill'. 112* . 
142 -079 013 

094 -f68 -23'4 
100 . -010' -2fe ' , • ' 

095 04 5. -06'3.^ • 
•018 028' 136'''- 

125 '••090' • 32,0 . * . 

116 1 37 , 270 . . .. 

083" 042 . • 090 ■ ' , . ./ 

072 -1.2 3. -025' 



095 -04 0 _ 2*31 

097 -2^22.- "^090 
.008' i)68' -042 

■\ ' ,011- -<^8t^ -064 

'021 -?33; 030 

085 -16/4. 120 

070 , '04 3 2J\ 

..• 020 . i94 290 

098 j6;&l -118 
■' 124 "^1691 -149 

21' 1.281 171 -048. • 14-r 052., -024 

22 V 110 241, 037- -i ' ' 151^ ' AbO' -03^8 



23 • '144 /1-06 . ■f004 ) ' -1-^- * 270, 009' 

24 m ■ 04F -04.9 .,102 1^86- --112^ ^- 

25 ."132- 14^- -221 ,^ =■•: , 079 l:i5' 070 

7 ' ' ' ' • " •■■ ' : ■ ^ • ^ '■' 

Decinnal- points are omitted! > ' - ^ " . * * - 1* 
; ' ' ■ ; ' 

'Coefficients oX Congracnc I* ^ ^ 

^-*^r~ I between. Above Factors ^ 



ERIC 







,..^^14-{-l)-'' 


^1^4(1) 






• 


' ;i4(ir 


• ^^4(1) . 


: ' '^M4{i)\ 




."J 


' . 9299' 
. 0000 
. 0000 


.0000 
-.4782 
;^0000 


. opoo 

. 0000 
■ • .2733 






» "* 




« * 
♦ * 


* 
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Items 



TABJ-rE l9*fcontinueci) 



.Normalized ^ongiruerit-'Fac tor Cqefficients £or 
Teacher Ratings and Stddt-nt Pre- te'st PerfoVmancer 



^ . Teacher 
Ratings 



'4(1) 




4(1) ^'4(lT~^'(l) 



Student 
,Pre-tfest 1 

^1 = ^I^ 



ri 



111 , 



Test _n 
27 

2-g 

■ 29 ' " 
30 



136 -2r27' 

128 -190 

J17 -176 

146 -079. 



•026 
•083 
•199 
•081 
-048 



151 -^18 ,.-060 

203 -050 -093 

085 -165 -027 - 
133 073 086 

163 -li>S '-169 



31 
32 
33 
34 
35 
36 

ii 

38 
39 
40 



104 
104 
096 
095 
.190 
179 
187 
174 
.176 
186 



-184 
-203 
-154 

Oil 
-168 
-158 . 
-127'^ 

132 
-046 
-080 



001 
056" 
004 
090 
■034 
■005 
006 
■001" 
-004 
038 



005 
089 
144 
018 
244 
203 
191 
156 
188 
129 



016 
-12 6 
-l35 
-030 
-2-1 6 
-088 
-200 
-192 
-005 
-167 



-1-32 
-112 
112. 
112 
110 
. 078 . 
176 
038. 
-03 9 
-068 



41 
42 
43 

44 
45 
46 
47 
48 
49 
50 

51 
52 
53 
54 



1 53 
163 
169 
1-86 
1 68 
175 
185 
185 
138 
139* 



-186 
-135 
-02 1 
-032 
-149 
-058 
176 
192. 
134 
074 



166 t-051 
163 032 
125 256 
150 197 



073- . 

074 
-004 
•04*2 
-020 
■064 

027 
-119 
•174 
•1 68 

030 
O'lO ' 
042 
•024 • 



1 .• 



•079 
218 
220 
141 
148 
197 
18-0 
167- 
1 37' 
135 

185 
145 
099 
189- 



-034. 
- 136 
-118 

009 
• 024 
,0Z9 

122 

142 
-056 

05-9 

231 
238 
216 
. 1-95 ■ 



-017 
042. 
Oik 

-05^ ' 

-1-90. 

-071 

-222 

-212 ^ 

^024-' 
.137 

024 
-106 

213 
-004 



Dec^malpoints are omitted. 
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TABLE 20 



4 



. Normalized Cpngrjlent^'FactoTeCoefficiients- for' 
Treacher Ratings ajid Student Post- test Perfgrtfiance 



^4 



, Teacher 
"J^tings 
(2) = 



Studeu-t 
PostTtest 



V • 
Z Z 



. Teachcrv 
Ratihgs 



^4(2) 



Items 

T 


■ ^4(2) 




. i , 
. 2 . 


ii- 


1 est *I 






1 




i » 


i 36 


— 136 


.• 124 


-206 


2 


J 25 


■^088 


086 


-069 




057 


14-1 


04 5 


-168 


4- • 


; 077 


009 




-054 


- 5 


■ 149',. 




071 


-l'3 5 


6- . 


•04 6*j 




• -020 


151 


7 


1 1,5 


1 65. 


' 074 


030 


' 'S. . 


104 


067- 


109 ■ 


0*59 


q 

* 7 




1 '> 7 
1 Cu 




O 


10 . 


062 


04 5 


|021 


-052 


• 


1 55 


062 


(J49 


-04 9' 




122 


-142 


:i53 


-'l86 


13 


oai 


-164 


'107 


-081 


14 ■/ . 


^068 


-180 


167 


-062- 


- 15- . 


'127 


- Zoo 


037 


-059^ 




. 146 


2-4 3 


036 


-107 


17 ' ^ 


071 


-1^0 


046 


-035 


• \ la 


050 


-154 


113 


^65 




r39' 


-060 


098 


W54 


20 • , 


-129 


.- 1 63 


• " 123 


-088- 


■ ' ,21 ' " 


098 


-106 


0,58 


•023 


: .22 


075 


.-212 


104- 


010 . 


23 i" 


128 


-063 


. 069 


-124 


. 24 


135 


■■' 065 


13-Q 


-1*37 




089 


068 


085 ■ 


■-061 








0' -X 





Coefficients of 'Cong^ue'hcfe 
betwe^'n Ab(jve Factors 

'"24(2) ' ^2^4(2) V ' 



'Items 

Test II 
'26' 
27 • 

. 28 
29 ' 
30 

yz 

33 
34 

35 ' 

36 ' 
• 37 

-38 ' 
39 - 
40 

41 , " 
'42 ' 
43 

44 ■ 
4 5/ 

4-6 ~ 
47 • 
. 48 . , 
49 
50 

d2 
53 

54, - 



'4(2) '^4(2) 



171 

1.-6^. 
' 136 

167 
•172 

1 56~ 
• 1-54 

147- 

122 . 

192 

18 6 ,^ 

186-i' 

143 
.1 68 

190 

1 72 
176, 
'l62 
1 64 
1J8 
161 
12^ 

1^.8; 

106' 
1.21 

«i ■ . 
174 

1^7 
'083 
.107 



-135 
-185" 
-i07^ . 
-213 
-128 

-111 » 
-1^5- . 
-1 50 
-a 08 
04 1 
04 9 • 
063, 
121 
064 • 
020 

•06L 
08C 

1 32 
172 • 

•2 9|7. 

2 7*7 
073 
052 • 

086' . 
■1 22,';^ 
•041 « 
222 ■ 



StucUnC- 
P,ost-lc-it 



r 



,121 
n 6.8 
'L^6 
1^4 
178^ 

167 

1 65 

1.92 

158 

'214' 

1 52 

178 

162 

129 

181/ 

062 
203 
215 
187 
194 



J037 

-219 
-123 

-on 

-038 
. 07 5 
-0'7 9- 
-0^ 
-114 
065 

-on 

-Oli 
-056 
-052 

- 213 
. 092 
- 009-. 

051- 
.' 081* 



1«^-108 



207 
129 
121, 
212 

\ 

128, 
18^. 
076 
078" ■ 



\ 



08^- 
'274 
147 
074- 

3,68 , 
^20 

367 
*342' 




• . TABLE 21 

Normali«z.c(4 Cc^ngruent- Factor Cox^lficients fo^ 
Tea<rher R'a tings afnd .Student Gains ' 



Teacher- , Student K 
Ratings * Gains 



Teacher ^] 
Ratin'Jjs 

'\(3) - ^..".(3) 



Stud( ni 
Gains 



Ite ms 


i 

^ 4(3) 


f i 

4(3) 




•"3 ■ , 


iff* ^Y^ ti 


'4(3) 


'^4(3)' 
















i e S I 11 










1 






U Da. 




C D • 


U o4 


n 1 A 

U 1 D 


r UU 7 


n Q 
- u 7 !:> 




1 1 7 
< ill 


-01 7 


'* - 1 jC 


- u 3 / 




1 U7 




U / 4 


- U'?b 


V * 




1 7 n 
1 3 U * 


r 1 ^ 0 


- 1 Z D 


CO * 


lib - 


-103 


004 


-228 


A 


10 1' 


1 Q Q 
1 70 


-•U / 4 


- 1 Ub 


o o 
6 V 


"1 Z 0 


130 


U3 5 


' 243 


c 


1 1 7 
« 11/ 


nn 7 




n ^ 7 
U b3 , 


7 n 
3U 


\ 15b 


0S3 


1 fe3 


- L '^0 


u 


13 1 


- 1 / U 




- 1 1 8 




* 






• / 


• 1 /I o 


i 1 4 


1 54 


086 ^ 


31 


1 08 


201 


249 




O 


1 /I o 


'1 O 1 ' 


1 O 1 

1 o4 


1 60 ^ 


32 , 


^098 


..133 


192 


031 


Q 

7 




Ud4^ 


A 0 V3 


OZ 0 


33 




200 


-017 


1 03 


10 . 


132 


139 


-037 


-107 


,34 . 


1 60 


179 


'194 


204 












35 


096 


-118 


rlU 


0:82 


1 1 
1 1 


* 117 
1 4 3 


04 0 - 


' nil' 
^-014 


-030 


36 




-06^ 


02-8 


-04 I 


1 L 


133^ 


U9d 


04 ^5 


- UJIJ3 


" O "7 


' 1 09 


■f\ r\ c\ 

-099 


-07b 


1 24 


1 % 
1 J 


n on 

U 7 f 


267 


. -OS^T 


1 5 Q 

1 Zo 


7 O 

38 


ift 7 O ' 

"To 


1 r\ r\ 

- 1 uu 


- U50 


r 04 5 


1 A 


129 


24 9 . 


7097" 


195 


7 O 

3 7, 


1 29 


r\ o Ci 

-089 




* 022 


1 J 


. ■ 122 


143 


-088 


144 - 


4 U 


1 \ L 
14b 


- 04 3 


106 


UU^ 


16 


1 50 


077 ^ 


-041 


.-032 
055 / 












1 7 


.117 


21 0 . 


167 


41 


^083 


028* ." 


~-02,4. 


^ UU 0 


18 


.• .12-5 


230 


227 


■ 182 


4-4 


107- 


- 022 


'030 


-064 


' 19 


192 


-120 


073 


001 


43 ■ 


1 34- 


-05 3,' ' 


. 180 


-018 


^20 


188 


-095 


185 


-091 . 


^4 . 


i:i4 


-143 


148 


-030 












' 4 5" 


1 03 > 


-065 


' 127 


-091 


, 21 


1 68 


'-163 , 


062 


-1 57 


46'. 


- 1 1 1 ■ 


-163 . 


06 1> 


^- I SS 


22 


176 


-097 « 


247 


-132 ■ 




1 ^\ 


- 1 9'3 ^ 


273 


-329 


23 


• 173 


r084 ' 


169 


-021 


4 8 


~ 143 


-276 ' 


234 


-314 


, 24 


' 154 ■ 


04 3 


223 




49 


14.2 


-'151 


• 04 1 




25 


^ 117. 


-23'9 


141 


060 . 


50 




-099 ^ 


191 


4 61 


1 


• 








51 


147* 


050 


190 


^ 121 








t 




52 


161- 




. -255 


22 3 










53 ■ 


179 


-09/ 


"015- 


. 316 




Coefficients of Congruence, 


54 


161 


-0%^ - 


-Oil 1 


190 




between Above 


Factors 
















^34(3) " 


^3^4(3) 


^ ^3. 




^* Decimal points 


are Omitte'd. 






^ '4(3) 


"4(3) 















11 



3 . . 6319 

3 .oooq 



0000 
4 381 



> .81 



•40 



..35 



.30 - 



Coef.'^of 
Congruence 

• = ,632 



.35 



-.30 




-.25 
-.39 -J 



--.20 



-*25 



L--.30 



'4r3) 



.40-1 



Coef. of 
Cohgrueace - 



r.40. 




•4(2) 



Figure 6 (ContinuedJ 
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Matching of the Normallzedv^Congf''uent - 
. - Factor Coefficients 
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. ' ' ■ /CHAPTEK V 

; " ^ •. ' • / ■ . ' DI'SCUSSION 



/ 

cr^f the Re 



• V 

1 . ^IhterpretatiorfT^f the.; ReS"ulls ** r 



Mean Student Pe»rfor manc e ^ • , * _ * 

. , .Looking at the mean student performance at the pre- test^administrations, 
* « • 

when instruction tjad just started, th'e students correctly answered more of the 

sub"itemg than we expected ,(45% of all the ^ub-i'ite^s); .Sipc;e ^t the post-test 

administration, the students coVrectly answered 67% o£ all 'tjie §ub-itcm^, it . 

» • *• 

does not n'ece ssarily* mean that the items prepared v.**ei:e too easy for the bamph. 

^ ^ . , > : , • 

of/ students, but it *rather means, that the gains through the course v,crc not great 

' • * • • ^ . ^ y 

• ♦ t 

In Figure 1, . any items which would appea^r m the upper left corner would be' 

difficult at the beginning oT the instruction but easy by the time instruotio-n \\ab 

' > . . , ' ^ ■ /' , 

completed so that they^ woal^d "sjiov^large gams. However, there \\erc onl\ two 



such items-, ^Ue^s 7 and '8'. , Mosi of th<^ itcm^s in t)^tfests appear c^Loser to the 
main diagohs,l which indicates "no gaiifw - >v ' ' * T * • 

The itums which were too easy"" at, the beginning of t^e hsst rue ti.o'i: rtllo,\ 'no 
room lor gains after instruction. Items 3, 9, M , 19; ib^ 56 and U TTia. 
be of this kfnd. *Mo\ye\er, the ceiling etfect is learly (^vi|dt n; 6nl\ !ur lu nis ' 
1 1 ^^and 41. Items I, 3,y 26 ahd ,3'^ mi'gh* have had morti jai'nb withou<*,tht . ■ 
ceiling, but thev show fairly good gains, c on^sidenng ^tjier items, -so the .ceiling 
effect rQdiy not have ^exi essivel/ inhibited the potentral gain^.pn thc^^e itenis. ' i 

^ ■ - ' • i ■ ' 

' spit^e of^having more spacQ .for gains. Items 9 and 19 did not sj^ow niurb. 

Other ite.ms having -statistically non- signif^i ant gairvs at the V'o -level siu' I <i>- 

* . ^ ' * . 

Itertis 6^ ^10, 13 and 20 were correctly answered at- about S0% fpr^ boil ur^ - ' 

test and f^ost-test admi nistrationjs . Item 34 was *fficnlt far <)oth pr; - anci 



post-'test ajiniinibtrations, and it* had no great gain in'spite.of <^mpU' pubbibiht^. 

Thu^ th^ low gains in general- evidently , art- not i:)ycaus'c the t(>st ilerhs tv'ert i asy 

b^it because tj^e imprdvement by instruction was not gr^4t. 

It should-be noticed, howe\er, that many ^ems wih'ot»e contc nts "were. no*t 

taught between the pre-and post-test afl;Tiini*Stratio^is were inelude<^ for the / ^ 

experin^ent^.! purpose. Low ^aias, then,^ do.*not necessarily meao the inelfet- 

tivC'ness of the teachers' instructioiv. or training t*o their students. Fi\e items 

' - ' . * \ , ^ • . 

/ _ . , / 

out of se^ven whose ^ains are not^§ignificantly different from zero are clabst- 
fied as least related to the test* ^(See T^ble "3.) T^his suggests that'the degree 
of 'relevance should Kav^g s-dme relation with mesan gain sc-ores. Following tht 

classification in'Taljie. 3^^.the means of nxean gain bc'ot.es for items were oom- 

s , ^ \ ^ 

puted for each group of items (See Table ZZ). The-m^an is 1.02 for'Group 

A, in which the corrtentb oi items are most c^loseiy related to the text. The 

me^n is . 9.8 for Group B, w[)ich the Contents of items*are moderately related 

to the text. ^The two mea*ns for. Groups A anfl B are not.greatty different but , 

V . » f - 4 * 

the me^an is .54 'lor Group C, in w.hich the- contents of items are least related' 

^ * * ' ' / ' ' ' \ 

\£> the text. This mean gain score is quite lov. cornpared with other two gfoups 

^f -Items. The contents bf the items whi'ch , belong to the first two groups ar^e. 

■ - ' ^ - • . y . ' ■ 

^related, to some extent, to what is taught between the two admi ni^strationb , Bu; 

for the m'ost of the items- o\ Group C, the contents \C eVe not taught between 

the two tests. Therefore, the Iqw mean of the gains for Gpoup C agree^^ with 

* • * ? * ' ' . , * 

what we wodld expect from commbn experience. 

' ' Looking at tha^ contents of items 7, 8,* 12, 17, 27, 4p and^47, .whifhNia\( 

larger^'gains thaft the others, four items out of seven are those which reqdire 

•students to have some knowledge of comput?ational rules. The rest^^of the items, 

12, 40 and 47, alsa se«m to retquire som^ drill after learning the Relevant 

mathematical principles.*.' Items which can be answered without the effort of 



thinking ab'out principles do not seem tp be included 1^' this group, la other 

\-- ' ■ ■ - - " 

words, these items would npt be answei:ed by simple rot^ .learning of math^mal- 
ical, concepts such as ** 'APA* is an abbreviation of the Associative Principle/ 
for. Additidn" or * 'The* equation '^Z + '3 = ^3 is an instance of the Commuta- 

tive PrShciple^for Addition, for instance. ^ •' ' . ' 

.... . ' * * ^ • . ^ ' \ r ^ \ 

Following dft\ L l^ssificcltion of Table 2, 'the^means of *thfi mean g^.in scofcs 

- ' " ' * ^ ' . ' ' ' ' , * 

,for each.group ar c ompdted (See Table .22). Th):^ mean is .72 fd*r G.roup 'A 

in w.hich the' que stions are asking for direct understandings of^*baibicf concepts.. 

The mean is' 1.0^ for Group B inV'hich the questions 4re asking some compu- 

tational work, and the mean is , 92 fdr Group ,C in which .same applied work 

using basic coVicepts is rcqiur-cd,. Th'fe means of thi' gain€ are th> highest for 

Group. B,j the secpn-d for Qroap C and the least for Grou'p A. This finding also 

^ ^ • ' ^ ' ' • ^ ' \ 

supports the conclusion^ thajt mprf progress was made dur ing ^the, c our se an items 

*r equiring 'Some drill-like compcftation or application of learned principles thr\n,, 

on those requiring simple knowledge of mathematicai terms or simple recqn- . 

nition of instanc es'^of mathem^ical concepts. • ^ 



Al^o, if we compute the means of tTie mean gain Scores for eacji group oi 



items, classified by format according to Table 1, the ni<^yan for the muitiple-. 
choice typ^' is ^ 76, the mean lot the numerical c^ompletion-type is^ 1. 13' and^- 
that for tfte type r (inquiring wrftten work is .,88,' The higjii^'st gain is ob^taine\ 
for Jhe group of items 'which can be answered by fillings with numerals or alge- 

. • * \ ' ' ■ :i , 

braic variables, .and ifie lowest gain is obtained for the gr.oup pf^multiple- cl\oicc 
type items. *This classification is not independent, 4iowev^r, of the content oi 
the items; As we have seen in Ifie preceding paragraph. the:items aski/ig fur 
simple basic conce^^t^ had the lowest gains^and more than two thirds of ^uch . 
items we^re multiple-choice type.\T'he it^m.§ asking' for some campufBlional 
work had th^ highest^ga^ins, ar>d .also ».more than two tp^r ds 'of such 'kj^nds^wcrc 
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•TAB'LE 22 



Meati StiStJent Gains and Teach*^ Ratings fol*. Different Types of.Ite-mS 



\ 



Answer Forms 



Number 
of 
Items 



Mean 
Student 



Mean 
Teacher* 





t 

A: Multiple- choice 


■•26' 




i: 


• ■ (' 

94 




B: Filling'with Numerals or Algebraic Letters 


»1'7 . 


1.13' • 


"64 • . 




C: Written Woirk • / 


'll 


. 88 


5. 


82 




Kequired' Abilities ^ 










t 


^ *Under standing o( Ba^ic Concepts . ' 


• 19 / 


.72 


■ 5. 


80 * 


■m 


B: Computational Skill. 




■1.09 


5. 


63 


*C: Ability of Application of Basic Concepts 




• .^2 


6- 


00 


\ 

't 


\ r • ^ ' 

Degree of Re'kfevance to the Te-xt 
A: Closely Related 








1 




r. ' 

22— ' / 


1. 02 








B: Moderately Related ^ ' ' # , 


20 


■ . 98 


,6. 


1 1 




C:* Least Related / » 


12 ■ 


54 _ 


5. 


39 • 




Cjrand Means over All the Items 


54. 


. 90 


5'. 


82 • 




Standard Deviation of Means ovei: All the Items 


54 
■ 


• . . 63 




4'9 








' \ 






4 . * 


• r ' * ' ' ' 

• * 

» 


• 


* 












s 






0 






* 


• 
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sinriply answerable by writing* nupierals repre senting the. outcomes of the Lompu- 
ta*tional work. Therefore, the differ^ences of 'the mean gainV would i>e the eo^- 
sequences of the natur.e'of the tasks rathef than of the answey forms, 

i . ; . - . 

To surrfmarize the stjxdent mean pei^orniances, a large number -of stud6:nts 
.eorrectly answered the tebt items before the contents wer,e taught. However, 



progress* in the course was not as great as was expected. It is partly because 



tl^ _ ^ ^ 

some of the test. contents were not taught betw^en-the pre-and post-test admin- 
istrations. The highest gain was obtained in the tasks which require som^ drill, 
or exercises on computation .or applications of the basic principles studied in the 
course/ In the tasks whiclj requii'e simple knowledge of mathematical terms or 
recognition of mathematical concepts, the gairi was low. For the tasks ^^hose 
C9ntents Were' not taught betw^een the pre- and post-test administrations, the gain 
» was the lowest. . ' ' 

. • ' ■ '■• . • ' . ' ■ • "■ '• ■ ■ 

Mean Teacher Ratings ^ | w ' 

The ne'xt question concerns how teachers evaluate the test items'. As can be 
seen in Table IZ, tne items which teachers ]^ke most are items 24, 35, 37 and^ 

45. " Judging from these items, it would ^eem that teachers like items that (1) 

' ' ^'-^ , ' . " 

are not directly drawn from^'the text but whose ^underlying concepts are closely 

related to it (Items Z4 and 45)^, (2) have a form and,c<>jate nt similar to problems 

in the text but whose instances are new (Items 35 and 37), and (3) include somd 

xqmputartional ^vork irt which comp,utation itself i-s not a main goal but only a , , 
ste*p to reach other mathematitabfconcepts (Items 24, 35, '37 and 45)., In short, 

.teachers seem to like ,9hallenging' problems. But this .tendency is not sjupported 
by all the data, * * > , * . , ' ' ^ 

Loc^king at the items rated lowest,, such .as Itenrs 13, 14, 17^, 18, *2ltand 
ZiZ, it seems obvious that teachers tend not to like items who^e contents are 
ly^taught'in the courfee, anH this is quite reasonable, ^HoweverJ disregarding 



^ ' ' ' ' • • , ' /■ /\. B.7 

.such obvious^ madeqCiatje items, ^eacherb bCi-m not'.to like items. tFhat have the 

following prope.rties;^ (^) 'simple computational work (Ift-iii 3), (2) straight- /' 
forwai*d and. airectly related to Jrhe text (Itcmb 2. and 41)^ (5^ inripropejr v^oxding 

(Item*j22*), " (4) too wordy for the expected outcomeb (Item '^3)/\and (5) con- 

' ' . ' * " ' ■ ' \ »" 

taining metamathematic s rather than conventional mathematics (Item .1).^ lh<. b< 

- ' ^ ^ V - 

tendencies also are not futly -supported by the evidence, ,since* ther^'are many' 
items which are not rated low that have the above'properties/;*-* / 

If we cornputt; ihv means of the mo'an tea^^ht r ratings for. each typV^ of iten-i '^ 

. ' " ' ' ' • ' ^\ , \ 

as we did for stirdont gaihb, the last column oi-TabU* [ZZ^^^is obtained. ' The ^ 

teacTiers do not like the items^.whose contVntb ajre^least related or irreje-vant 10 ' . 
thp text (5.39). They Hk^ the items whose cuntentb are somev^hat modified 
from the examples inThc text (b/l-l) more than questions taken directly' irom 
tTie t^xt (5. 79)^. The tea(. ht^r also seem to like ^questionS^vJiic h rec^uirjcj. ^ome , 
applied work usihg basu »..oncepts in the 'text (b. 00) and th(;y like less those * 

* ' \ * ■ ■ ' • "■ - \ -■ 

requiring simple computation- (d, 63) or Hired qut'stionb on the'basic mathe- 

/ * O • . ^ \ IK . 

matical concepts (5.80). The teacherb see^n to muiltiple-choice items ' . 

(5.94) more than simple writing of numerical \alues or algebraic variabh - 
(5.64). It may be partly because a numbei: oi the computations vvhich ar^- disliked 

= ' ^ . . , ' ' . " \ 

by teachers are included in the latter catesk^ory. * Thc^ difterehce betwc^^'ii ihe \ 
multiple-choice type (5. 94)^ and the wri tten-\\ ork type (5. 8Z) is not grerU. \^ 

These general tendencies inferred fi^^m the ratings on iKe^test items would 

j>,. * ' " r 'I 

'be strengthened* by i n^\^es^igati ng the teachers' responses lo \Vie questrion^. on tjieir 

teaching objectives and preler(?nces on tesJ: construction. 

» -^As seen in the que sti^^nnai re (Appendix B), Item 9 in the' preliminary part 

of the questionnaire asks the teachers 'to rank several objectives according to 



r The te rfn /arithmetic \ alue ' is used in th/' text instead ''of 'absolute value'. 

' With spme exceptions, the general tendencies described also -hold for the 

four Pekin teachers;' (Se^ Table 12.) ' , 





\ * * 

- - J 
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are gLvenln Table <i3; A ranking for Ihi; t ntire sample w<is, obtained by ordering 
•tiic^avWage \anks oven all teache r & .'^'^hc teachers thij^ that such abilities as , 

understanding mathematical concepts, dis^^overing mathematical r elationsKips, 

' \ ♦ \ • ' . 

\ \ ' ^ * • • 

and deductive rea^^ning are more important than skill "in numerical computation 
and remembering mathematical principles A The^e findings ar e consonant with 
the earlier finding th'at the teachers tend to e v'alCiate mor e highly mathematically,*^ 
sound items than those simply requiring riumer icaljwork or rote mem^ory of 
^mathematic'at concepts. The teachers rank la^t the ability to ^apply mat^matical Ji 



skills to rc'^il lifc\^ro^J«mb.^ This must be the final goal of the mathematics 

s seen 
ent 



education, buf m*os tHeache r s seem to thirik it a /go^^s:.,e^ote from everyday 
^teaching. . Kendall's^ coefficient ^f concorda-nce *(Kendall, 1955) may be,^ good' 
index to show .ho\^ the teachers' rankings resemble each other, ^ind a value of 
W .62^5 obtained whic h ,^ppe4r s to be a fairly high degree of concordance. 

Table 24 shows the iiat^an vakies and the st.\ndard deviations the teachers' 



preference^ on test construe tron based (uvlti-m 10 oi the q\iestionnaire-. I he 
task gi\en was 16 mark the prpportion' itt ni.-^ according to the kcsy wor^s 

" - " . • 

*shoun in the fa'oK . li the tncaji proportion is h h.-- than 50.0, it means tlial l_|ie 
teachers r^rc u r ittArnr> c havcic tt' ri xed l)v tht right- hand word to those characterized 
"^jv ihv left-hand word. If the mean»\aiiu- Jrc-atiT than SO. 0, -the ref^tionis 

n. ^ • ' \ . ^ 

the reveyse. This table should then describe the teachers' ici^as or expectations . 
* ' ' j * " ♦ . \ ' 

concerning test cpnstruotion. ' The teachers^ p^^efe r , relati v'elyxliffic ult i-tcnYs to y,) 
relatively easy'ones. They, prefer the. multiplv-choi^^^^e ^to thd c ohTp^t^e t i o n ^ ."^X 
type. They Irke non-verbal hems and items with lew w^ords better. than items 
'» v'ith many words. The^y like quick response straightforward, and familiar ♦ 
ques^tions better than time-consuming, tritky, and i^far^niliar questions. They 
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Total 

Sample 

Rankin g 

* 1 

■ 2 
3 

.4 ' 

5 

, 6 . 
• 7 ^ 

8 — 



Ra.nks ot^bilidc s sire 



TTABXE • 
sscd by the 



Avemge 
-Rctnks 

1. 57 
2 .'59 . 
.4^05 

5. 05 ■ 
' •5.t)8 

5. 27 

5. 62 
- 6.-78, 



UICSM Teat hers 
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Abilities 
— 1, — . 




Understanding mathcMTiatical concepts 4 * 
DiseoveWng matfh.ematic^l r elati.onsh'ips* v 
Dedtictive reasoning ' * . - ' ' 

Skill id s^mbolN;. manipulation 

Gene^::alizing from c oncrete, abjects to abstract ideas 
.SkiJ^ijn^riumeric'at^oi.1^ , , ^ % jtf 

Remembering mathematical principles » * 
Applying mathem^tic al- ski lis to real life probPems 



• XABLE.24 . • 

The Preferred Proportions of Items 'of Different Kinds to be Included 
^ hn a Test for Gr^dnng ^ . • , 



-Left ^* Means 

Key of 
W^rds ^ N Percenta£es 



^Sta^darfi 
Devia^tions 
o4 Percentages 



felatively easy 


48. 


1 


16;i 


multiplc-tlhoic e 




1 




verbul 


43. 


8 1 


19. 5 


many words 


40. 


9 




» time-consuming 


-12. 


5 


21 . 6 


s traightfoKvard' 


64. 




25. 8 


' farhi4:iaT 


66. 


P 


22. 0 


\ \ . basic 


60. 


5 .• 


16.4 


concrete 


• 58. 


0 


17. 7 


computational . ' 


51 . 


8 


16^ . 


'reasoning 


■ 60. 


4 


, 18.4 


* • inductive 


49. 




15.4 • 


teacher constructed 


50. 




« 23.-6 











#Righi 
Key 
Words 



relatively diffic,ult 
co^iiplction 
' non- ve rbal 
lev, \v or ci'b 
cfaick response 
! t ri cky 
^unfamiliar 
\ applied V * ' . ^ 
abstract 
conceptual^ 
recall 
deductive 

UICSM project Construe ted 



like baSic, t^uiu rctc, c ojjipit National,, ,reciS(5rfLn^, awd dcdiKliv-L' type* questioH^ ' 
* #* ' * % , ^ ' \ ^ * • 

better than applied., , abst2^at,i, l one 0{:^ttial,"Vt.'(;J^l and inductive ty.pt^ qaestiorih: . 
Finally, they want to inclu'de te'actvpr-rrcadV^ ^len^'^. an'd made items ip 

^ halfra«nd-hali ratio. Of caur^<5, ,the ,deg,ree offj^^e fere nee ib di£Xerent for/ /, 
ch question, andlt may bt^oted'b^^ We^^.v*^ of • tiic mean value iVorh* 50^. 0*. 



oach 



Of course,- the mean, valu^ itself does not tell uliefher the preferences of the 

tdachers are'sinlilar or diverse, but the standard 5k' viat^0,u^f '^fee teacher^' 

preferejices would inrdicate this fact. * • . , A * ^ ^ ' ' 

In mo'st'cases, th*.^ ^teacher^' preferences agree with (or at least do^ hot 

cantr^^dict)' 'the findings from the tQath^rs'- r^tinj^s on the »indi3, idual tost items, 

although some caution is nrcessary. It \v oUld be understandable that they^like 

'reasoning, deductive, and familiar items bett^^han ^recall, indue tive,--' an<i 

unfamiliar UemSj^'^t the fact that they likf basic, computational, and ne^Vi- . / . 

verbal items better thUn applied, conceptual, and \erbal items^appears con'*- . 

tradictory to what^ve have reported in^he earlier part of the study. The teachers 

respond to the cjuestions here by comparing the^gi\en bipolar uords, and thgir * ' 

responses are a function of thp giyfen words. Fo*r example, the ".basic vs. appli' d 

» ' ' ' 

'of which the teachers are thinking here must be'tiifferent from* the 'basic' items? 

and the 'applied' 'ite ms that we havp clas'siiied 1, it the earlier study. . the" for mer 

' * " ' '^^ I . - « • 

case, teachers must have^ interpretefl *basic ' as nikj^jining a sound, under standing; 

and a pre^recj^uisite fbr applietl work, lo the latter case, hQwever, "by 'bas'ic' 

was meant questions taken directly from the text, and 'applied' meant an ability 

to work new tfipes, w^hich is the test of a sound und€>)^ standing of the underlyii^g' 

• • -■ . , , ■ ' , . ^ •• .V. _ - • 

.conc^^pts. A similar argument may holA fpr they^ue stion * straightforward \^s-. 



* 1 V 

••'"l^The* Uj^CSM author? ernphAsize ^b oth deductive andj/iductive reasoning^. 

/ ► • • • * ' 
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*tricky.\ ' HoucviT, 'comparing the i^timulub words on hptri' side's, most of the 

• '* ^•.* ' . = ■ . - • 

teacher^ r/esponses^seem understandable. 9 ' [' - * 

•i f he .next problem is^to see', the relationship bcjtweer^ mean teacher ratings 



atid mean-stude^nt.petiorma^jcesXor each'ite'm.' Befpre investigating^fl^e'^elation- 
sj^ips 'bectween t\vc5 kinds^of responses frohi different ^abje>*4 grViup's, V<e shbuld 
Jjear in mind ffiat one. assumption-was in;^c^ve^. The sarQples of tefbchers were 

* , V- ' . 1 ♦ > • H • 

Mi^o^m^^?^'dif-£-e-ri^l^^h:€K>j■ 3 in 19 s ^ate^, *-^^p^H^^Ter^ti-jt^^^Vr4 de area in theJIm-ted — 




States^ On t^ic other "hand, thet'samjilc of the students tbnsi^ted ^f si^class^ ^, ^ 

taught Tby; four teachers, from dne local high ^Lh£>oi in Illvnojls. / Wfcfen 

tfallsing* about teac her- student relationships in'terms of fesporises on^est tt<?ms, 

f we are'interesfed in only the coRTmon tendencies that appeared in*hoth' tea(.;hcr 

. dnd student groups. We are^inlerested^in whe.thcr' most students have o5 have 

no.t commonly 'shown gaiws. Cor instance^ on it^nis^ which 'most , teacher ^ c^i^ 

monly emphasize. 'W^e 'do not .assume that any* |>ai*tic/ul^,r ehiphascs differ,/ent from 

* • ' ' . . ' ^ / * ' , 

* • ^ other classes were made in thest sample classes. ' Of ccu*^^, if the teachers 

who are teacljing 'the clas5T?s w-htth^are used tor tlii's. stvidy have 'excessi v^elv , 
different objectives and different Vav^ of U ac hing Ir om other teachers, the ' ' 

v.-^^ \, ^ teacher-'sKident rcJalions*hips VwhicH we are going t^di^cuss. here wculjd lS|6se 
' * i£iS, validity. Houev^r, since there is no i^easonto belLeve that these teachers 

^ , . . ' , ■ ' . > ' • , ■ / - • ■ . . - 

had biased objective^ from Dthe.rs, ihc^se teachers w ere^^ssurped to be typical 
teachers in. the United States. 'Tlie year.s .of teaching e^'erience o'f mathe^rriaji^ ^ . 

* for these teachers are four', fi^e, twelve, sixtfeen ye^^^s, ^and t'he years of tea^-h-^ ^ 

• * ^ » .*.'*! 

' -.ing^UniCs I and if 9f UICSM old texts are one, two,' seve'n, and eight ye'ats, ^ ,^'4'^^ 
; ^ '•respectively. They tobk three, two, three, and two courses; respectively, 
in which* the contejats 0/ ufcSlvl curriculum Vw cf^ev)studied. Ideally, -when 
talk about the relaticj^ship bctv^'een teacher ■"l^e Id objective&>.and student* per- 
■ * formance, the student performance should refer^to the perforrnance in the class 

• ^. *■ ■• „ • . . ■ ^ , .; • ■ 

EMC' \ - . • - ' : . \ . 
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taught by the tcacHer under consideration. .We .^jhould-ftnd .the relationships . < 
between the 'teacher -held' qbjec'tive.s and his stud^rtt per^for mance . However^ it* 

s •>'•.; ' ^ • . . • ■ ' . 

Avould i:equire a much4onger and larger-scale reseafclj f©r this purp6*se. 

Now' a*s seeain Figures '2 and 3-, no particular tendencies are found be- ' 
twden rriean teaser ra*tiSigs and mea^n^^sttident performances in the pre- and ^he * • 
post-te st rife But a Vno^e important question is to ask if the students develop 
.therV'abilTty along the line that the teacher s 'think important. 

' - . ' • / : ' ^ ' ^ . ' 

To some*.l&xt^^, the answ.er is yes, but not co^np^etely so. As we have ' 
*** **' * ' • 

seen in the fiorst section of this ch§,ptG.r, the studept'b progressed -iViore *in appl^eii 

'^work.than in basic conceptual work, and t^hc teachers also thought, the former 

would be better, tha^ the latter in the ratings^/or .items . The' students s-howed* 

more progress for^the mod^i'ed questions , than for .questions that were the sarnie 

as in the "text. The teachers also liked fiiodified questi'?)ns better than direct 

ohe^s. The correlation al the mea*n student gain scores with the teacher r^tiligs 

oveTH|enns was .53 if a lev. exceptional items were taken put (Figure '4). This 

is not a'strong relationship but there is a positive tendcncybetween, the teachers 

objectives and the students progress. 



There is also a discrepancy between them. The ^^eachers think that simple 
computational work is i^ot so important compared with other aspects, as far as 
the items presented are concerned, but the students showed the greatest progress 
in this kirid>of*work. Since the^iujmputational work requires some k.nowledge of 



bp^r^tit^hah^^les and drill, thfe progress due to instruction would be most e^^^c- 
tive. >Witnout kno^yledge of me rules an*d, drill we could not expect the student to 
progress in mathematics, 'and thfs' effect seems'most evident in such a task as 
.cqn^iputation. The teacher ^ insplied to'Item 10 of the .questionnaire, indicating . . 
.that they would include computational items more than 50% it^ their test^ on the 
aver^a^ge. ' TJie teachers must reijognize, in general, the importance of such drills 

) , ; V ' ^ 

as a basis ^for developing the'students ' ability in mathematics, , 



To 'summarise the tea<;he*r .ra/c^gs of the items, 'the te.achers emphasiz^, 
*in general,* the.ability of basic and conceptiial understanding jefL^^tfiernatic s 
and its application rather than the rofte rhemory or mechanical Apglicatvon of * 
mith.ematical rules. They like (questions modified from the examples ©f the ^' 



text, but the questions* should be based ih the principles ta'ugh^f. ' They wa?*!^* 
exclude the questions whose solutions are based ^on principles not taught, Tfiis * 
is reasonable, and in fact the stude.nts showed little proglress in such questions. 

. '• ^ ' \ . ^ ' ^- ' 

^The teachers' objectives inferred from the meah ratings fo;r the itenis are, in 
many cases, understandable in the Hg^t of thfeir responses -to the que s.tj^nnairek 
asking Cor their general tea.c|iihg obje*ctives and attitudes towa'fd test construc- 
tion, although, some caution. is nec^-s^ary/ There is no particular relatiansTTi^rt^ 
between the teacher ratings and the student, performances on the pre- and'tl^^ 

^ ^ , ^ 

post-test, bat there are posi4.^ve but not str'bng tendencies between the mear> 
ratings and the mqan gain scores. The student progress tends to' be^large in 
the item's which the* teacher s .think important, although there are some excep- 
.tions,^^as sjeen in j^ke computational type itenis. ' 

' ... ■ r.y . i : 

Principal Factors for Student Pe^tfbr maryce k./' 

. ' * * 

As mentioned in the previous chapter, have obtained three factors from 
the'inter cor relations among items ft)r student pre-test scores and'also two ^ 

^adtots from the student post-test scores. For the gain score th^ factor analysis 
results' were more ambiguous than for the pre-test scores and post-test^score's, u 
the first two principal factors accounted for only .10. 8% of the score variances. 
Also, since the factor analysis of .the -student gains failed to yield interesting 
results,it Will -ijot be discussed. ^ ^ 

The principal axes could be rotated by ^orrfe criterion like the v^rimax* 

,CHarman, i960). Hoy/ever^fthe*"^ of the fa?ctors^ill be done^witliout 

rptation, since the ppincip&l axes themselves, par ticularly 'the first pAncipal 



axis, have several significant characteristics as will be, seen later, Varima?c. 



rotations were triecTand did not lead marki^d irti^»vements in the interpret- 
^ability of the factor space. . . ^ , ' * ^ 

t For th'e pre-t^t cas<i, the lirst fad^tor refers to th-e' abili«ty which students 



already h^d wh^rins'tr action of the tfxt started. For the pbst-t^st case'^ the 

first factor implies the students' ge*neral ability on the^ given tests whose con- , 

'_ ^ ^ V ' , ' 

tents have been taught. * # . \ ' 

Judging from the contents of the items, ,the ffr^t principal factor for the 

.pre-test seems to be related to a ve^rbal vs. nurr>erical dim'ension. The&majority^ 



of items with low coefficients are numerical t)r aorriputational type'* problems ^ 
such as .Items 13, 14, 17, 31^ am^^ 34* On the other hand, items with, high 
coefficients on tfii s .factor seem to be related to the ver b^l de scriotion of ^ 
.mathematical 'problems or they are related to the ability of mathematical forrn- 
ulation fr^om verbal' stateme nts\ as seen in It^fms i^, 30, ^2, 43, 46, 47, 48 
and 54. * Another important characteristiX is that the items with an illustrative- 
example (whith suggests, not how to w^rit? answers, tJat how to think) are likely 
to have high coefficient^. vFor example; Items 22, 27, 30^ *39, 42, 47 and 
48. 

* The imj:flication of th^S^e findings i s in^'pcTrtant. A^s the first principal axis 
is generally cl*ose to the (irst centroid axis,'tl;ie fir^t principal factor coefficients 
indicate the degree of the relationship *6l e^chvitem with the mean of all the ' 
rtems. Suppose that these items are used for an ap^titu'de test and th^^mean of ^ 

If I 

the item scores over alj'the items is used for a measure of the student aptitude. ^ 
The first principal. factor coeffi^iients indicate the degr^ of contribution of each 
item to the aptitude defined above. The itei^*s *'with low coefficients do not serve 
as good aptitude test items'. Fxo/n wh^.t we have found* in |:he preceding para- 
graphs, we^^may conclude that the con:iputati ohel type 'items are not good for 
♦aptij;ir^e test items in this sense. Since computation requires some knowledge 
of rule for operation and some practice, 'it may not be an aptitude." On the , 



> 
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other hand, the ability t^ formulate mathematical g.oncepts describe.d verbally 
In mathematical form may be 'a good indication ol the possibility of reathing a 
high level of achievement in later learning. When^some mathematical iUustra- 
tipns are, presented, the ability to catch. the mathematical essence from the 
illustrations- and the ability to apply it to the gi\cn problems is also an^ptitude 
f-or getting a high-level of 'achievement in mathenriatics. Thus,- the first principal 
factor coefficients of items for the pre-test seem§ to suggest which items are 

.good on^s for inclusion in an aptitude test. , * 

* * * * - * 

^ , The. second principal factor for stvwlent pre-te'st seems to be a time-related 

effect^ Items with high coefficients 'are located near the end of both Tests I and*" 

II (Items 22, 23, 24, ^5, 51;, 52, 53'-, and 54). Otherwise, items appear to 

need a lot of time to answer perhaps makinrg. students hesitate to do themjirst 

^ - ' ^ .. 

(Items 8, 18, 47 and'' 48). Oa the other hand, items with high negative coef- 
ficients are. likely to" be multiple-choice type which can be responded to quickly, 
- or at least, tl^||p.e items lt>ok easy and most students are likely'^to attempt to 
do them first. Items 3, 12, 15, 16, 2g, 35, 37, 38, 40, 42 and 43 are 
examples, ^ 

The third principal fact'or for the student pre-test is hard to interpret. 
Items with high coefficients are Items, 7, '8, 11, 17, ' 18, 37 and 53. They 
^re problems involving multiplication, division, andlth'e Taws ^f operation 
such as the cjommutative , laws^ thelt'ssociative laws, etc. Items w^ith high . ^ 

■ ■ % 

-^addition, mathematicakfoxmulation in using quantilief s, and finding the num- 
. bers o^.ropts of equations. Since there is ^no'consistent pa^ern, we would like, 
to leave this factor unidentified, ^ ' 

For the ^ost-test, * the first' principal factor seems to' be closely related^ 
the objectives of the given UICSM text. The items which have high ..coefficients 
on this factor Seem to accord with what the text emphasizes in. the giVen chapters. 



r 



negatively coefficients are I<!^ms^3, 4, W5, .47. and. 48. They ai:e prxoblems in. 
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Items 29, iO, ii, - 35., 37, 40, 42, 4 3',.. 44,^ 45, 46, 47 and 50". are the ex- , 
amples. On the oth'e^ hand, item's With low coeffiQienJs, such aS 9, 10/ .1-5, 
16, 17 and Zl, arfe less emphasized in the' given. chapters. This is an important 
requirement for t'he achieve;rnent t^st, and the first principal factor coefficients ^ 
s^em to indicate which item's are good ones, for the achievement test. The be- 
haviors of Items 6* and 41 are unique for. bath pre- and pdst-test data. Item^ 6 
is a challenging type of problem an-d it does not follow the ge'ner.al pattern*in 
m&.ny other cases. However, the low coefficient 'of Item ,41 is difficult to under-, 

stand* ^ * \ y ' " * - 

The interpretation of the second ^rinc^pal factor for the student po.3t-test 

/ ' * ^\ ' ' * * I ' ' * • ' J ' 

*»ia not easy. Items with high cpefficient'3; are Items il , 48, 51^ o2^ '53^ and 54,, 

a^d iterns^with high negative coefficients arjs 1, 3., 12, 19, and 28. Although 
' ' - " ' ^ " • • . ' • , ^ • " ' \ 

* ' no consistent patterns exist among them, ItemsM and Z8 are rather inductive 

and straightforwar'd type proble'm^,. while Items. 51, '52, 53 ;,and 54. appear tp^ 

be logical-reasoning aj:id deductive-ty^e problems. ' Looking at inductiv^- ty^e 
. *^ * ^ - , s ' • . " ' ' 

^ pr^pblerris such as Items' 15,/ 25 -arid 39^s^ they ail have negative coefficients. 

\ However, 'there *are many deductive type, items with negative cc^ffici^nts^ 
^ this ^Inductiye-jdeductivc' inter pretatijonns not relia-blc. , ^ 

* The analysis o/ student .gain scores was not considered in this, discussion due 
^..'to the lack of interesting results. * , ' 
^ the. second factors are difficuft to int.erpret for the student'data, ^nd this 

is not improved^by rotatio^;^ of axes. Th« reason for the difficulty of interpre-' 
' " ► ' • " J • 

^ ta^ion'^of the second factd^b is. due to. the fa^t that the^ are almost indistinguish- 

ablS* from random factor^s. The fetors whj[ch we could use with some reliability 

^ ' are only the first ones.- In fact, onlyrthe first faCtors"a^e* congruent with -the : 

factors for teacher ratings; when the^ are matched with*-t^acher factors. 

* " . ^ • * : . • 

In* summary;', the 4irst principal factor .from ^student pre- test data is inter- 
'-preted as a general* aptitude fastcJr i^'whi(;h items requiring an abij^ty to grasp 
mathematical concepts from, verbal ^tademeftt have hx|h coefficients fend items 
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; t requi;ring some kriowledgu of ;|Tiathematic'al rules*and practice have low c'oef- * 
J ficients on. this factor. ,The second .principal £a<;tor from student pre-tests.is 

interpreted as a time factor .in \vhich time-consuming items or items located * ' 
^ hear the 'end of tke tests ]iave ,Mgh positive 'coeffiv^jits, and i'tems .quickly, " ' [, 

•• • - ." ■ ^ ^* ^ , ; • . • " 

responded to have high negative coefficients T ' The Wir rf p^rncdpaj factor for 
■ .Student' pre-test iS'.haj'd to interpret , and it is left unidentified.^ ^ ♦ ' 

'For the student post- test, ' the fir st^^rii/ci'^^ factor is'interjyrGtecf' a^s a ge'n(?r- 
al ac)iie-vemfcnt factor, in which items ^tres^e'd in the 'te^ have higR coe'ffixiepts 
on.this factor. *Dtems'v.1iich^are nat t'r^eatcd irj-the chapters under consic^eratiLon 
"d.to have l^ow coeffic i(,-nts oh thiS fadtoT* ,l,he secoad pri%t:ipal factor is 
J ^^eted as.a de-ducti\'fc.'-iJiduc?iv^ factor';' b^^t U'is-^-nOt a. cle^r j^erpre-t^ • 

» / * /Principal Factors fo^r Teachej* Rating's* > , , * *^ . ' 'ift^ - < ' ' ' \ ^ . ^' • J|P 



teftd- 
•interpre^tec 



• 'Five factor's wei-e ^ext^racted^/no fn the. tea^^h^ j 

, ' ' ' ,* ' . * S * ' ' ' *^ 4 

ponent method. The fifst principal faf.«tor is' relai^Nd let th^. teacher^* .individual 

differences on 4Jaei r/?a tings taken ks a>y.hble7 A^-fhe frr^^.priadtp^aVa.^^^^^ i ^ *J 
expected to<»be close to the frr^s't cejit^oicl a^^is Wmch repr^X?,nts,'*th'^ mean'oL^ / \ 
the ^standard. rating J> bf^all t^ijc- itfm.b/ thV JiV^^l l^r^c^ ipa?^ 



. to the general tendency of each- teacher 'W^r'^Urt^^v 'T^er^fb're^ it'^n^y*)^ inters' 
preted as reflecting the 'te,acher-s^ genera:! r|"spon&e"set Jqr all the ile;msV ' 
Items v.ith high 'cOLefficients 'igreate^.thah < 70) ,ort €his f^cJ.^Y«are 5, ^11% -.24, 

' . " ' '\ ' ; ' \> ^ ' 

. 29/ 30,^ 31, 35, 3-6, '37,. ^B8;, 40, .41, -.4^^ 43*, '51 ^knd o2.. Mo^t of them , 

are items in Test-J^*/ /fhese ^ibe^mb (especi^Uy t'hbsb Test, II) *a^e*mostly , 
^ ' . c'onceptuaL type items.. Itcm^ whiuh are irrelevant *to**tfie tex»t.are likely t3 have • 
* ' ••low coefficients on this factor. Some'^sp^cts of Uhe relevance of iton^s tp the * ' 
text ^re then confounded y. ith the Second and the third priwcigal Sacioj:^ which 
, will be describetfln the ncjft para^gVapJjy., . ' r'* . > i ' ♦ 

\ Both the second and th/6 ihitd prirlcipal factors Jjeem to be related to the 
reieva'nce of items to the text, but the two factorb'arc 'different in som^e char- 
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acteristic,s, It^ms with high goefficiehts on the sjecond factor, are : 9, JO, 1*3, j ■ 

■ r , . -^'^ * • • . , * ' . 

14, 17. and 18 and they '^re'^omputatiorial type^pr'^ablerris oh"\yhich the teaching - 

IS delayed to latfer chapters, .b'ut the qire^st^ons^ the.rasel>/e's are.qaite straight- 

^ . \ ; • . . ' ' ^ ' ' / • 

forward. Itemf' with high^coefficients on th'e' third fafc tor ar^ 19, 2X)," 21, 2*2, 
2o3 and 25 whose cpnfents*a*re about inequalities, uBsolute values and symbolic 
manipulations. The contents of these items is taughtionly later or taugjlt in a 
different way from what the items re-quire. For exartiple, . the tferm **absolute 
value*' ih Item 22 is not used^in the text; instead, the term **arithmetic value"^' 
.is'used. Items 21 .a[nd 25 are application' problems of abstr^^ct symbols and the 



same l^nd of question is not practiced in the text. 

^Another important characteristics of the second factor is 'that this factor is 
related to conventional mathematics problems v*s . .new mathematics , problems » • 
Looking at item? with high negative coefficients such as Items 1, 5, 6, 25, 2fe, • 
35, 36,' 44, '46, 48, '49 and 50, they are* dealing with new fnathematic prob- <« 
.lems such as me tamathematic s, symbolic operations, generalization, open 
sentences, the principles Of real numbers, quantifiers and so on. , On the pther 
hand, iterjns with high pos^rJLiA'e coiefficients ^re rather traditional skill-ori<* nted 
problems. 'Ihis characteristic is impo2*tant but il overlaCtps,w\th ^relevance to - 
the text. ^ ' , • ' , ^ . 

'-The'T^rttj principal factor seems to refer to an algebraic factor. Item*s with 
«high coefficient on this factor j^^re; likely to treat ^algebraic^ manipulatibri in- 
cluding algebraic variables, ' a, b, x, y, etc. .Items 3, 4,' Zlr 28, 29, 30, 
31, 33 and '3^4 are the exarpples. On th^ other hand, .items with high negative 
, coefficients a^re' likely to be rriore conceptual as seen in Items 35, 36, 37, 41, 
42, 4fl, 4'6, 47,, and. 48: They do not r eqojir^-actual algebraic operations* 
The fifth. principal factor is'h^rd to interpj:ei. Items with high positiv-<? 
coefficients are 3, '4, 6, 7, 8, 9, 47, "48, 53 and 54,. while it^m*s with 



f 



high negative coefficients a're 15, 16, 26,. 27 , 29 and 32. Comparing, » 
the contents of both groups ctf items, ho systematic patter n ^i s^ found. » fjende, 
'we had 'better- leive this factor unidentified^* — ] .'"^ 

Congruent Factors between Student Performance an*d Teacher Ratings 

/■ ' - ^ • ■ 

,,The next probleirf is to-rnatch ^he teacher faptor^^ith the s^tudent factors.' 

As h^ve'seen iiL^he e^^^^^^chapter , gnly one (composite factor from student 

' darta is*congruent with on'fev composite factor from teacher data. ^Comparing two 

fact9r cpefiic ients- matched for; StudeTit pre-test,and teacher ratings, items witji , 

high coefficients for both student and teacher' data are Ite,ms 35, 36, 37, 38, 

39, 42, 43, 44, 46,'. 47, 48, 5,1, 52 and 54 All are rtems^n Test II. and 

generally they are all cl'osely related to'the contents of t>e text. Items \yhioh 

have low coefficients for both teacher and student data are Items 3, 6, 9, 10, 

42, '13, 14, 15, l6, 18, 31,, 32 and 34. Most of^them arevcomputational- 

type problems, and they require that students have soiTieJknowl^dge of rules for 

operation and .practice. 'Ltfe^ms witj> gfeat discrepancies betw.een the two factors 

are Items b and 41. Both have high coefficients for 'teacher ratings and -low 

coefficients foi*. student pre-tests.* Item 6 is a s-bmewhat peculiar item, 3.nd 

. Its behavior is Hard to uMerstand, ^'So is Item '41. Generially speaki-ng, 

* conceptual items andit;,ems closely, attached to th e - t rtnTf tend^ b^^e high coef- 

ficients oTi both teacher and student new factors. Cjomputational type ite^s which 

;require students to have some knowle^dge and practice tend to h^ve low^coeffi- 
' ♦ ' -* ' / ' ' ' ' ■ ' * 

^..ci^nts.on both. teacher and stud'ent factors. Thus,- this conceptual ^ 



If the. factors were rotated^^^he-interpr^talion might-have been easier. How- 
' ever, rotation by* the varirnax criterion did''not significantly increase the estse 
of the interpretations. TJie whole system Qf factor interpretation by the vari- 
msoc method was much the same as, that, by the principal axes method. 

"^"^ For easier comparison,, the fac l^or coefficients (see Ta^e, 19) are .nor maliZQd 
over all tiie items. * ^ ^ ^ - 



comfHitatibnal factor is ^ congrue'ht factor for teacher ratings ^nd student? per - 
forn^nce at the pr;e-:test stage. The coefficient of j^ohgr uence is^Jj7^30. 

As for a congruent space over teacher ratings and student post-te%'t data; it 
should, be* noticed that the student congruent factor is the same as the first prin- 
cipal factor'. As seen in Table 18, the transformation matrix is the identity 
rhatrix and the result is not -changed by the transformation from the first prin- 
cipal axis for post7test data, to a new axisi, maximally congruent with the cor- 
responding new factor for .teacher ratings'. A similar argument holds for the 
.tr"ansformati6n'of the teacher niatrix.- 'The first row first column eleipent of the 
matrix Y4(2) Table 18 is nearly one, and the re^t ot the elements in the first 
columo are nearly zero. This means that the new teacher ;axis is not signifi- 
cantly changed from the original first principal factor axis for teache,r ratings. 
In other words, the first principal factors for students and. teachers are them- 
selves almost maximaroly congruent with each other. In fact, the coefficients 
of factor similarity between the first principal factors is /928 (Table 16), and 
it is close to the maximum coefficient of cqngj^uence .941 after transformation. 

Items which have -high coefficient^ on both data ior students, and teachers 
are Items 27, 29, 30, 31, 32, 35, 36, 37, 40, 42, 43, 44., 45, 46 and 52. 
They are closely related to the -contents of thf tc^xt,^ The difference Jfrom the pre- 
test case is that items which require -sdme algebraic manipulation are now^in- 
eluded in the post-test case. Items 2?, 29, 30, 31,* and 32 are the examples. 
To lie a<!:custp^ed to such algebraic manipulation may be necessary in order to 
answer these questions, and this'v^ould be expected as a conse^^nce of atudy 
and practice based on the text. Item^ which have low coefficients on both kinds of 
data are 3, 4, 6, 9, 10; 13, 17,^21, 25 and 53. M6st 'of them are the items 
^whose g'qntents are trivial or not,taught between the pre-test and the post-test 
administrations. Thus the congruent factor for the teacher raMngs*and the s^^tu^ent 
performance at the post-test time seems to be a factor which stands for a general 

/V r " . . . • 4 

i 
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mathematical achievement*'. along the content of the text. The degree of>c'on- 
gruence is hfgher than the pre-test case an<J the coefficient is ..941. Thus the 
new matched general factor for teacher ratings is-highly congruent with the 
students* general Achievement on the post- tests. 

Let us summarize our findings for con'gruent factors. Only one factor from 
student post-test data Is regarded as congruent with\a factor from teacher . 
ratings. The factor coefficients of, the items for students general performance 
•at the end of instruction are similaj to the coefficients of the items for a rtew 



factor foT^teacher ratings. Items asking for the urrtter standing of basic 
mathematical concepts and the skill in algebraic manipulation (based on the 
cont^fes of the .text) are closely related to these two congruent facto^ (one for 




student performance and one for teacher ratings). In fact the student general 
achievement factor (^the first principal factor for post-test data) is itself 
^m^-ximally congruent with the new factor for teacher ratings. aI'so, the fir^t 
principal factor for teacher ratings (response ^et^ is almost maximally con 
griient with students* general ability. 

Another new fattor fo'f^ teacher ratings was matched with student pre-test 
performance witl^ high congruence, although the degree of the congruence is 
slightly lower than that^obtained for the postrtest data. Student ability to work 

\ 

' on the tasks which are closely related to the content of the text contribute to 

this factor, but ability on the tasks which need some knowledge and practice ' J 

does not contribute. Both of these abilities contribute in th|b cas'e of post-test 

. ,data. ' • 

Student gains from pre-test to post- test failed to ^s how a high congruence 

with teacher ratings. We found s-ome positive relationshifc) between mean values 
* . ' ' 

^ 'bf student gains and those of teacher ratings in the ,earlie(f analysis. But, in 

the analysis of factorial structures, in which th-e ^ffects/o^f mean gains and mean 

* * • / , • » ' 

ratings vVere taken^ut, *a high similarity between both structures was not found, 

ERIC • •. ■ . 




Thatjs^the. strongest relationship between student gain scores and teacher ; 
ratings is that'%elween their mean values. ^ - <^ I 

, * . . ^ 2. Problenas and Suggestions for Future Study " ' 

In the preceding sjection, we have analysed and dis-^ussed the, results we 
obtained, /But spll bume problems exist in this study. Some of the problems 
will be aiscusB-ed and studies needed in the. future will be suggested. ^ 

. i^irst of all, w^e found that the intercor relations-arrroTrg- ^ t udeiit s c o r es ' — ^ 

of itei^is, particularly, amdiag- gain scores were generally lower than the inter- . 
correlations among 'teacher ratings. Usually, the intercor relations among^ 
cognitive tests are higher than those we h^vc obtained*for the student data here/''^ 
One reason would be because y^hat we'used for correlations were not a set o*f ^ 
long tests but a set of short composites of foir sub-item's, • This was done 
because -we intended t*o prepare and administer as many kinds of items as pos-* 
sible within a. given limit of time. If njlich time is allow^ed for administration, 
we Should use^a longer test which consists of many items, as a unit. This is 
particularly important for obtaining meaningful gain scores*, since the. r.eliability 

of gain scores will usually be less than the Reliabilities of the pre- and post-tes 

' / ' * \ 

scores unless both are highly reliable', i<5uilford, 1.954, p. 394; Cronbach,\t 

' / / • ^ ' ' ■ < \ 

1960, p. 287). ; ^ . < V 

We obtained only two thr ee^'^orlrimon factors 5rom the intercor relations j 
among student^scor es- in spite o/the.fact that we used 54 items as variables. 
They account for only a smali^ pod^tion of the total varia/nce cjf the var^bles 
about 20% 'for the pre- ana post- tests and lOfo lor J&ie, gain ,st;ores . Such 
^low communalities resulted fr^om the low ^cori^ations among test scores', and. 



J- S^ the data from French (1951) or Thurstone (1958), for example. 



further, .they came from the fact tnat we used srria'll u^it'^ of sub-items as 

- * / * » ' ' 

\^ariables. ThisMefect was especially evident, for the gain scores. The reason 

why we could not 'find a fruitful conclusion from the factor analysis of t\ie gain 

, scores Would mostly come from this reason. 

For the facl^or* analytic model used in this study, we started frdm the 

a*nalysis of intercor relatioh niiatrices rather than the analysis ql variance- 



covariance matrices or the cross-product matrices.. In the study of the re- 
lationship bet\yeen teacher mean- rating^- -and student mean-gain scores on 
items, sonrle positive, not strong, r elationsjiip has been found except' for a few 

items. In the factor analysis of the intercorr elations of gain score, this effect 

/ s > • . . . 

i 3. taken out since all the mean values of items are standardized to 'be zero;;. 
With this model, it is only interesting what group of items gained in the same 
direction and what group of i^ems gained in other directions,. If we take the 
absolute magnitude \)f gain scores into consideration, some other result might 
be- f o.und. i ' , " - 

^ 4 • ^ 

The similar argument may be possible for the ^variance-cpvariUnce of 
item^. All the variances of item^s are'standardized to unity in the model of* , 

"' ' . ■ r 

this study. TJie units of measurement for student scores and- teacher ratings 
are different and the variability of the samples of subjects are also different. 
This problem hal not been- deeply considered here. For fdture study', some 
modifi^ed model in which the^e effects are taken into account would be neqessary 
On the construction oPtest^tems as stimuli,' the items were collected and 

T 

t 

made ii\a somewhat arbitrary way. Since thisrkind of study was th^ first*trial 
for the UICSM subject material, we did nofassume, a pri - o ri , any definite 
diro'^ensions of variables. This study was rather an exploratory type for finding 
what dimensions are important to student performance and teacher ratings, and 
no rigprous experimental design was made assuming the important dimensions 
of factors, as experimental psychologists and statisticians are likely to do. It 



would ber'^necessary in a future/studyv, howey.er, that^the •stimulusj*;materials *\ 
be arritnged' from this point of yiew on the b^sis? of the finding from the factor 
analytic study/ . * ' • . >.^^; • ^ 

■ Several variations are possible concerning the intervals between the pre- 
. t^st and post-t-^stf In this study, Test I based o.n the first diree chapters of 
the text^was pre-tfested when teaching for.. Chapter started and it \yas post'-, 
tested when teach^ngior Chapter 3. ended. Test__IL based on Chaj)ters 4 and^5 - 
of the text was^pre-tested when the teacHing for Chapter 4 Started and it was 

< , • » - , ^ t 

post-tested when the teuching.sC^X Chapter^ 5 ended. We could, of course, ^give ^ 
both Tests I and II as a pre-test' when the teaching for Chapter 1 starts, and 
give them as a post-test when the^teaching for Chapter 5 or the first sennester- 
ehdS'.^'Or, we could split Tests* I a.nd II into small seetiqns for each chapter 
and give them at the interme^at^e points in* each chapter. We cpuld also design 
an experiment so that both T«est^I and^II are given at every section of the 
chapters or some equivalent place, in order to find the effects of transfer and 
forgetting of the previous chapters. Such kinds of research need more careful 
and long--term experiments, but they seem important to understanding the process 
of student learning. • , * . 

The teacher-held objectives should be reflected. on the effect of their teaching 
to their own students. ' Wha"^ we'want to know is the facts on which the students 
who have been taught by a teacher who holds such and such objectives showed 
such and such'progr es^^ duripg the study of course. We used only four^ teacher s 
and Iheir students from one school^for this purpose. To draw a fruitful con- 
clusicmdLn'tRie respect, 'we need mpre classes irom different schools and their 
teachers. A- longer t^rngi and larger scale of research is also recjuired. 

At any rate/, we are stajiding just a^ the introductory stage,' and this-study 
would seirve as the first step to the long'way to' the ultimate goal. 
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.» ^'This study was designed to investigate sor^e possible relationships between 
' # teacherrKeld objectives and student perfprmance that appeared in respo'hses lo 
samples of test itenns of the new UICSlVT^iigh school mathematics. 

Two' test booklets, Test I and' Test II, Av^re made on t*he basis oi the con- 
stents qf the first five chapters of ** High S^ho6l Mather iiatics, Course by 
Max' Beberman and H. E: Vaughan (1964). ' Most • the. items cansisted of- four 

sub-item«»with the s^me contentand style. The scores'w-ere obtained for 

■ * f " 

^ -ea-ch item by the number of correct answers of the sub-items. Twenty-five and 
• \' • . * 

tWerity-nine iterns. w^re used for Test I and Test II, ;respe,ctively. 

Test I, as g^pre-test, was given to 9th grade Pekin Community High School 
» students irrliiinx)is when classes started, and the ^sahie"* test was given, as a post- 

test, ib the. sahne ^'tu'dents when instruction for the first three^chapter s of the • 

^ ^ ' " . <. ^ ' * • ^ 

test cfn which the te^st content^; were based was finished. Test II> as a pre- 
tfe^.t/was also given to the ,s^pie ^students on the ds^y after Test I was. given as 

' ' I * " ' • ' . •' 

a p6^J-test.. TestTI, ^as a po&t-test, was given to, the saime ^students when ih- 

struction for Chapters 4 and, 5 on which the test contents were based was 

/• ► ' ' * , • ' ♦ , 

finished. Each test was giveiTrusing the ordinary 60 minutes-cl^ss ^peripd. .The 

gain scores for ^54 .students were obtained for eaCch j.tem. ' 

- - , A Hctor- analytic method w^s, applied to* the thi:ee sets of intercorr el^tions 

; among items^ based on the pf e-test, ,^ost-te^t and* gain scoJies of students. 

Three, two^ 'and two^actors ivere. obtained from the pre-test, post-t^st and gain 



scores^, respectively 

* A questionnaire was made^asking teachers ^;o,qvalua't^^e suitability. of. .fh^, 
. test items (the same as those gi^^en to* the s'tuder>ts) fo><rse in an'achievefnent 
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test at the end uf instruction in given chapters. The ratihgs for items were 
/assumed. to be*an indirect indication* uf the tt^acher-h.^ld objectives for teaching the 
subjects. The questionnaire wab sent tu all the t^athers who were using, the new 
text, ^d 105 responses were collected from 70 different schools in 19 different 
states. , " » ' ' " . • 

t 

The interc or relations among teacher ratmgs, for items were factor analyzed 
and five factors were extracted. In or^^^r to see the factorial congruence between 
teacher rating^ and student performance, a canonic*al type of analysis was carried 
oibt'. for the sets of the student pre -tests and the teacher ratings, of thye student 



post-tes'ts,;^nd the teacher ratings, and of the student gains and the teacher ratings. 
The factor.s fou^J*from both student scores and teacher ratings, were transformed 



so that the maximum congruence, between them was obtained. 

The main results found through the analyses in. this study were as follovl's; 

* 1. No particular ^rel^-tionships were found between mean yatues of the teacher 
{^^tings and the student performance on either pr e -test\tem s or post-test items, 
even when the mean v^lue^s for'^Pekin teachers onlv were coritsidered.- 

* 2 • A weakly positive relationship was found between mean values of the 

' ' ■ * \ ■■■■ ■ V ' . • \ 

teacher ratrngb a.nd 'the --Student gams. The *teac he-r s fm{^ha&i7.e.d s^ound uxvieX' 
standing of basic c unccpts ^^ther than the^simplc r o^<^learni*ng ol^iiroathematical 



concepts x>t--sxnapiy mechanical computations. ^Generally, the student progre 



ss 



meets this Icmd of 'teacher objectives, but the students showed the highest progress 

. " * >■ ■' ' ■ . • " ■ ■• . / ■• ■ 

in nume rical type problems for whigh some^practice was .re quired. ^ 
^ 3. The-fjrst principki factoj for the student pre-tests indicated a general 
aptitude for learning matht^matic s . -Th^ ability to translate a verbal statement' 
into^ mathematical expi^ession, for example, was important, while a compu- 
tktional skill itself was not important at this stage. • ^ * 

4. The sec ond. principal factor for the student pre-te^ts w^s* related to 
the order of the itenQS which the ^t.udent attempted. Time -copsilming item^s and 
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the items near the end of the tests were' likely to have high coeffrcients oi} this^ 

factor. . * » . 

* 

The third principal^ fkcton for the student pre«j«#ests ,was hard to int^erpret, 
and it was left unidentified. 

6. 'The first principal factor fQr the s'tudent pcjfet- tests indicated general 

achievement for mathematics related to the given contents of the text. The abil- . 

' ' . ' ' * ^ 

ity/whi.ch was emphasized in the text was closely related to this factor.^ 

7. ^The secqnd principal "fac tor fpr the student post- test^^seemed to be 
related to a deductij/e-inductive factor. But it wa^^ not clear. 

8. The factors found among student gain scores were ambiguous and in- 
texpretation was considered too tenuous to Vv4fr?aht further consideration. 

9., For the principal factors for teacher ratings, the-fi'r^t factor was 
related to individual differences in the general tendency-of^ each teacher's ratings^ 

% . . ■ , 

i.e., teachers* general response set. Items*asking ^or the understandings of the 
basic mathematical concepts tended to have high coefficients on this 'factor, and- / 
items which werlSrtvelevant to the test te.nded to have Iqw coefficients^*^ 

^ 10. The second and the third fa^:tor were related to the irrelevance of the 
-items to the cojitQ#its in the text. The second factor was related to simple com--^^-'' 

putational abilities which wili be taught later. The third factor, how^evei*, ^re- 
■ferre'd to abilities something apart from the text. The second factor y/'ds, also 

. ' ^ -•" / • 

related to the conventional vs. new mathematics problems. ' ' • 

11. The^ fourth principal factor referred to a conceptual vs^ alg^ebraic 

ability. Some skill of algebraic manipulation such as simplifying mathematical 

"expre^ftns and^olving equations ^'^-S positively related to this f-acto^.^ 

12. The fifth principal factor was difficult to interpret and it was left 
* <^ 

unidentified. . . ' - 




13. Only one factorv^iach from student ,pr<.'- te^t and post-test data was con- 
gruent with teacher- rating iactorsT Tht*. (^oilgrae nt factor between student per- 
forrtiance in the pre- tests and teache^r ratings was related to the knowledge that* 
students already^ had that was closely delated to the contents of th^e text. *iA.bility 
which needs practice was not important. The congruent factor between ^tud^nt 
performance in tlie post-testb and teacher ratings, however, was-mor^e related 
to the achrevcment of th^ objectives wj^jich were supposed in the text. Both basic 
concepts and algebrai^ mahipula4:ion emphasi/.ed in the text were "important for 
both studenfs and teachers. ' The contents \vhich wei"e not taught were naturally 
unimportant for both stuuciiis arW leache r ^. It should be noticed that the first 
principal factor f'or the student performance on the post-t.ests was itself most 



congruent with teacher ratings, two factorial structures* matched with 

students' general achie v e^ent ancf teacKe ns' ratdngi^ were highly cojagruent 
(cg^ficient of cor^g^uence^ .941). 

14. A low coefficient of congruence v^'as obtained betw^een the student gains 



and the teacher rating , and no cons i stent patter n& were found between them. 
> ^ , ; • ^ X . 

The two factorial st,rue tares, in which tht * eff ec t 'of the* mean \alues of student 
gains and of teacher ratings were taken out, wcOre no^longer similar with each 
bther. Although there. was some poslti^e relation^ship b('tw(^/6n mean values 
of student 'gains and of^eacher ratings, the second matched-factoxs m all three 
cases of^tudent perform^cince were non-cohgruent with the teacher ratings. 

15, Finally several problems includ^in this study were discussed and 
some necessary sfudies in future were suggested. 
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28 • TF5 J19Q-- " - 

29 -0^. 179 -j_66 ■ 

30 ' 0'79 'HE 141 Oil 




^3 - 

k 


.34 










13f. ' 


* 


238 


026 


137 


108 


* 356 


128 


, 227- 


086' 


-039 


-029 


02"^ ^ 


•-027 



r' 



204 . \ 

42Q. »176 ^ 

III- 




^1 13^ 139. •'093 '.-119 ' 066 O9O '051 00^' 048 -loa ' 09.9 028 -200 264 -031 

52 j_90" ■ ji«8 ,-130 .111 .v-063 -009 042' -0 54 00"1 ■-^06£ 047 -041 IIX. 144 

53' ■ 009- 077 »\12B-^ 24-1- -'14^' .-J0S4« -120 '. -0 59' - 043 .068 ,075 01i8-044 -020 -061 

54 073 .^t/06.. 230 -008 -019 -043 ' 032-' 087 a=09 018 ■ O'^O 062 -.029 



4 i\r^" 



^_ " ' * V. ' TABLE I (Continued) * . 

Intercorrel^tions of Pr^-test Scbres among Items ^ ^ 

' - [ ■ • . . / u 

Items 41 '42,. 43 44 45 .. '46 47 -48 49 50 ^ 51 52 SB.'* 54' * 

• .... 

26 . . ■ . - / - • 

28 /' * . - 

29 / • ■ ' . * 

• 30 ' - ; - ... 



31»' 

32 

33 

35 
36 
37 

38 V. 

39 ' 
4"0 

41 



4-2 


. -054 




















43 


-028 


407 














m 




44 


\ -201 


148 


126 






f 










4S ' 


* -110 


.185 


211 


220 














46 


• -025- 


Ml 


• 164 


074 


143 < 












47 


-10.5 


215 


094 


196 


260 


296 










4* 


V ..l 59 ■ 


V 128 


1(37. 


191 


325 


288 


" 701 






,49 


-20 5 


l65 


181 


, 144 


106 


114 


038 


: 039 






50 


-r?4 




. '058 


123 


074 


156 


084 


a58 • 


112 




51 . 


,-026 


135 


"\l8 


1)^8 


247 


089' 


129 


241- 


039 


217 


52 


-051 


-049 ■ 


103 


154 


12-2 


02A 


218 


227 


i88 


-oH 


53 


-040 


-072 


' -015 


016 ■ • 


-116 


0 5Q' 


-054 


04^ 


040 


173 


54 


';<i068 ' 


076" 


100 


1*64 " 


097 


226 


195 ' 


-236 ■ 


148 


120* 




t * 






< 


f 








» 










• 








1 

* 
























w 





p bd. -U!5l -U49 1U3 154 KJM. CIO CC I >oo -uti . 351 

53 ' -040 -072 ' -015 016- -1 16 05Q' -054 043 040 173 ' ]27T 



352 ■ 237 330 
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TABLE II 

Inte rcorr elations of Post-tes't Scores among Items* 



Items 



2- . -3 



405 



6- 



8 , 1 9. - 10 



1 1 



' 1 
2 
3 

• ■ 4 
5 

7 
8 
9 
10 

1 1 
IZ 
13 
14 
15 
16 
17 

18 
t. 19 

20 

■ 21 
' ZZ 
■ 23 
. • 24 

. 25 



'iLOb ' 

m 
200 

-025 
099 • 
037 
-041 
-084 

' 206 
188 
128 

' 171 



170 
005 
097 
023 
-097 
■ 122 
-033 
022 

327 
142' 
042 
093 



-059 ( ■ Oi 

033 
-009' -09§ 



■ 04* 



143 
10-7 
181 

158 

.157 

ME 
190 
092 



075^ 
168 
-039 

095 
-063 
154 
0<^0 
063 



/ 

123 

-002 -010 

004 --015 
097 034 
006 026 

-039 115 

117 -014 



074 
013 
^60 
-006 
-027 , 
p 1 6 ' 
085 
#47, 
170 
03-3 



078 
OQ'9 
-023 
-020 
-^42 
- 166 
-083 
-080 
-021 
06"0 



027 115 

•08d 038 

-025 • 036 

067 ^U3 

^035 



084 

0.2 !• -114 
067 .-119 
054 -070 
-006' 060 



024 
129 
124.. 
189 

ToT 

068' 



■019 
1 iq 
■045' 
'062 
091 



099^ 
-07 5 

-dw 

-•07 3 
-167 



Oli 
030 -088 
194 -0Q9 
114 - 222 
lb2 -074 



. 135 
- 1 o6 
- 173 
66 
03 5 



275 

-013 

010 
197 



■014 



' 086- 
101 
110 
171 
147 
-050 
-008 

08-2 
O'-^A 
108' 
1 50 
-026 



-087 


171 


m 






013 


-094 


Oli 






169 


-025 


067 


'216 




-061 


015 


-041 


106 


258 


1.34 ■ 


.096 


-104- 


129 


192 


,10u 


078 


07'1 


130" 


125 


083 




072 


-069 


108 


09(^ 


-01> 


N_081 


084- . 


078 


-015 


-027 


117 


043 


131 


- 037 


098 


094 


019 


026 


076 


152 


082 


-028 


032 


-031 


' 042 


-029 


-123 


108 


.047 


1 57 


-032 


019 


107 


061 - 


. 166 


083 


-030 ■ 


656 


108 


070. 


-023 


034 


266 


" 0.05 


223 


0,32 


.055 


01^ 



* Decirhal points afe omitted, ^ ^ ^ . ^ , ^ / 

Underlined cor relcttions- ar e bigniJicantly dyferent from, zero at tKe 5% level. ^ 





TABLE II (ContinuVd) r 
• Intercorrelations of Post-J^est Scoreb among Iteons 



Items 1 Z ' 3 4 ' 5 6 ^ 7 - 8 ^ 9 , ' iO i 1 ,12. . 

s ' ' - 



?.6 


043 ■ 


0 58 


005 


,061 


035 


' 052 


084 


0O2 


-037 


074 


025 


124 


27 


ioi. 


206 


0 58. 


007 


2r7 


-030 ■ 


02? 


203 


0.52 


t 053 


059 


. 153 


28 


286 


199 


177 


086 


07b 


-024 


018 


086 


016 


056 


001 




2.9 • 


174 


038 


023 


, 126 


144 


-182 


166 


' 171 


212 


• 059 


007 


"re? 


3-0 • 


280 


-00b 


-068 


-057 


085 


■ 002 


039 


124 


088 


- 127 


096 


247 


fl 


r52 


124 


.. i.3ir 


. 094 


082 


127 


030 


078 


'l 3b 


05b 


037 


27 3 


"32 


079 


■ ^061 


058 


0^b5 


008 


'010 


081 


1 82 


044 


00 1' 


-094 


107 


33 


197 


1 55 


090- , 


-018 


193 


043 


004 


135 


-039' 


-033 


-02 5 


234 


,34 


.'156 


067 


* 1.05 ■ 


r05I 


176 


-223 


-027 


032 


097 


157 


-026 


, 1'68 


-3 5 


10b 


143 


' 132 


-050 1^ 


003 


-021 


1 19 


'1*83 


-07 2 


-073 


03 1 


350 


36 


076 


027 


-140 


-012 


-027 


,-09!^ 


f 1 52 


205 


032 


-022 ■ 


061 


1 5 b 


37 


028 


'■ 169 


1 58 


-OBO 


-008 


-013 


057 


1 56 


082 


010. 


-025 


308 


38 


il 189 


071 


122 


.015 


-103 


-0 57 


,103 


'l48 


-012 


-018 


-045 


255 


*39 


155 


-007' 


-017 


128 


134 


-012 


077 


222 


-007- 


-105 


033 


174 


40 


163 


1 50 


10^ 


13b 


loO 


- 106 


102 


1 37 


07 5 


^ 00 1 


19p 


258 


41 • 


0*25 


-Ob^ 


- 1 5t; 


-108 


-ObO. 


1 37 


-024 


-0'30 


01-8 


04'9 


■ -037 


-098 


42 


z\z 


101 


-0 19 


127 


^02 5 


087 


Ob5 


23b ' 


012 


-019 


2^0 


' 109 


43 


179 


• 205 


051 


-003 


"115 


058 .. 


-033 


14?.' 


1 12 


T88 


1 b4 


219 


44 


l219 


^0 38 


1 2o 


067 


-01b 


029 


1 16 


M(f ■ 


162 


-039 


-012 


123 


45 


03 3 


054 


1 2'5 


016 . 


142 ^ 


008 ■ 


243 


216 


055 


084 . 


f-058 


245 


46 


V89 


197 


0"2^ 


02b 


07 6 


081 


056 


a52 


-053- 


043 


070 ■ 


12b 


47 


253 


^1 


08b 


047 


037 


0=^9 


074 


,028 


012' 


. 138 


182 - 


229 


48 


025* 


i 46 


^ 032 . 


014 ' 


01 1 


0b9 


049 


087 


-020 


-01b 


141 


019 


49 


206 


• 144 


^ 041 


068 


02b 


-042 


■ObB 


■ 142 


003 


O09 


084 


■ 1^8 


50 


b25 


193^~ 0-35 


073 


12b 


-07 3 


100 


097 


146 


159 


-016 


257 



I 

51 -064 023 -054 -022' -003 051 235 237 029 -051 -063 019 

52 14^ * 032 -045 013 - 071 ,tObl WK> 1.55 072 03 1 097 172 
, 53 -135— 151 -024" -009 -0^2^ 033 027 ' 106 -050 -052 -0.18 -081 

54 -0-81 1 52 - 102 -013 -01b 090 1 13 130 • 135 -02 1 -098. -08b 



) 
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' TABLE II (Continued) 
^.Intercor relations of Post-te^Scores among Items 



•'Items 


. ♦ 

13 


.14 


t 

15 


16 


•17 


18 


19 


20 




22 


ft 

23 


24 


25. 


« 


205 


III 


-050 


* 

013; 


-061 


212 


163 ' 


053 


085 


027 


1 32 


. ' 052 


081 


27 


-017 


266 


life 


-032. 


0^ 


108 . 


168- 


089 


095 . 


181 


103 


13 5^ 


0 30 


28 


-008 


147 


059 


-008 


-148 


062 


1 14 


1 58 


187 


123 


188 


252 


131. 


29 


177 


21 1 


084 


1 1 1 


057' 


1 52 


138 


245 


-063 


145 


LIZ 


143' 


19-1 


* -30 ' 


091 


. 282 


.05<^? 


079 


039 


Ool 


098 


27 1 


062 


}51 


040 


1 <^'9 


1 56 
















021 


■ " ■ 




• 








31 


128 


04b 


-012 


026 


-002, 


■ 18^- 


-004 


-012 


082 


125 


QoO 


0o9 


32 


^ 084 


194 


- 163 


024 • 


088 


1 1 2 


141 


. 173 


. 050- 


082 ' 


/ 026 


144 


084 


33 ' 


* 144 


169 


0^4 


-007 ■ 


• 02.9 


.129 


200 


211 


• 1 19 


109 


^ 17.8 


060 


02<) 


34 


n4 


.1 10 


042 


133 


031 


136 


137 


2^1 


020 


160 


109 


041 


214 


3S« 


.ogt) 


244 


148 


134 


092 


147 


Ib2 


188 


099 


-017 


12.5 


181 


210 


io 


1 55 


124 


^ J04 


049 


041 


226 


0^5 


114 


ft65 


092 . 


147 


1 1 3 


1 10 


37 


. 174 


238 


042 


174 


023 


107 


078 


049 


-04 1 


054 


112 


183 


105 


38 


148 


, 064 


-01 S 


029 


-0 17 


078 


127 


0*}> 


' 22,5 


158 


■ 152 


134- 


10^ 


' 39 


169 


^ 1^3 


-074 


-002 


049 


lb6 


-020 


'£K)2 


-0 14 


I ^4 


-02 1 


108 


1 10 


40 • 


215 


22b 


I 10 


003, 


152 ' 


1=.8 

• 


■ ^2 ' 


237- 


08') 


, 5 


03^ 


• 189 


D81 . 


41 


209 


08>5 




of^ 


-044 


02n 


-087 


097 


1 10 


-07') 


-045^ 


-0^)3 


073 


42 


085 


. , 210 


-034 




1 59 


1 b6' 


J 7 9. 


^59 


1 80 


09 1 


040 


- 2ji,i., 


107* 


43 


240 


34^ 


047 


■ F39 . 


, 060 


184' 


- 172 


147 


. i084 


120" 


089- 


229 


191 


44' 


; 10 6 


147 


037 


058 


02 => 


127 


0'3 3 


225 


134 


111 


-01*5 


• 21 3 


171 


45 


162 


258 


-0S2 . 


■134 


065 


1 r4 


107 


125 


17 1 


li?3 


0^9 


. Tbf- ^ 


1*04 


46 


091 


138 


-087 


009 


-05^ 


U3 


084 


;i-8^;^ 


026 


104 


047 


188 


14- 


• . 47 ' 


091 


n2i 


0^4 


ObO 


1 l6 


1^9 


6 062 


121 


147 


17'4 


05^ 


20 1 


034 


•48 


. -t004 


•-015 


-032 


028 


035 ^ 


069 


■076 


089 


0 14 


28 Iv 


-640- 


057 


020 


. 49 


089 


. 100. 


008 


' 135 . 


-067 


050 


-^1 


-003 


• 03(2 


1'31 - 


-OU 


-0'=>9 


Ool 


50 


137 


'26^ 


121 




000 


167 


234 


196 


007 


168 


lo3 


2O0 


0^8 


' 51 


^" 0 38 


114 


083 


-051 


154 


160 


-0 54 


069 


021 


102 


-044 


15q 


039 


52 


171' 


263 


025 


-058 


0 59 ~ 


"129 


1 10, 


09^ 


025 - 


1 14 


039 


I02 


052 


53 


-029 


141 


109 


•^0'66.^ 


-131" . ' 


-082 


-055 


*0 12 


084 ' 


. 069 


041 


0,0 3 •■ 


OK? 


. '54 ■ 


-077 


05b* 


07 1 


-056 


. 064 


113- 


002 


-01 1 


069 


037 . 


%r 


-003- 


016 




"J & 3 



TABLE U (Continued) ^ ' 

Intercorrelations of Post-test Scores among, Items 





Items 


2b 


27 


28 


29 


30 


31 


32 


^ 33 


. 34 


3 5 




) — 
















• 








27 , 


214 












— 










28 


173 


335 




















' 29 


105 


111 


278 


















30 


080 


26.9 


209 


■ 2d0 




* 













31 


073 


20J 


274 


300 


282 










• 




32 


022 


! 52 


222 


188 


554 


379 












33 


l^b 


233 


273 


31b 


277;^ 


3 50 












34 


091 , 


225 


218 


388 


203 


.2 37 


313. 


315 r 








3 5. 


291 


304 


403 


237 


262 


274 


175 


461 


185 






36 ■ 


209 


056 


114 


/2b8 


! 55 


1 59 • 


in 


173 


019 


29-5 




' 37 


185 


203 


190 


2'i=^ 


274 


374' 


24'2 


322- 


156 


424 




'38 ^ 


147 


TO. 


261 


181 


\ 2=^8 


192 


. 340 


355 


27 3 


-308 






100 


Ill 


253 


17 1 


268 


24b 


107 


107 


^01 


SOb 






125 


203 
. > 


1 59 


•20 f, 


1 t)Q- 


141 


248 


2h 


1 DO 


288 




41 


124 


-143. 


-070 


-{)'32 


107 


083 


184 


03b 


'01 ^ 


101 




42 


, 1.44 


. 245 


lt>7 


■ 317 


181 , 


101^ 


.205 


• 2b3 


180 


349 






' 2*4^ • 


2T9 


207 


2S0 


217 


204 


171 




220 


364 




44 


091 


197 


201 


234 


21Q 


255 


■ 287 


14- 


198 


212 




43 


230 


298 


■ 148 


' 184 


. 10=i 


■ 121 


21Q 


244 


182 


374 




. . '4h 


270 


244 


2 \'L 


1 -0 


. .J_92 


207 


iU / 


t(J ~> 


f "7 Z 

1 7 -> 






.\7 ■ 


174v 


221 


153 


23« 


2 Tb 


29T 


177 


297 


1-1 


2sfl 




48- 


091 


062 


100 


042 


TT5 


189 ' 


177 


1,27 


-■14b 


122 




49 


1 17 , 


075 


0b4 


. 107 


176 


189 


—634- 


1 1 5 


-001 


201 




50 


248 


283 . 


251 


242 


299 


247 


191 


243 . 


248 


301 






024 . 


197 


-008 


. 106 


154 


095 


• 20-1 


067 


142 


■ ,04b 




• 52 - 


. lor- 


183" 


04i 


253 


261 


222 


344. 


288 


364 


142 




53 


-022 ■ 


1 53 


-028 


049 


130. 


002 


09^ 


p88 


J93 


-004 


144 


54 


045 


, 024 


-093 


070 


0b5 


089 


111" 


""085 


012 


■ 079 


0 


i 








4 












• ♦ 



36 37 38 , 39 40 
. — ^ 



2b 1 

418 134 

184 - J_bO 

Tb3 210 



288 
331 
248 
257 
Tb^ ■ 
282 

295 
lO'l 

163 

287 378 



049 
116 
023 
241 



0b8 
153 
304 
248 

HI 

231 . 

318 
03^ 
170 



•013 
054 
044 
189 



07 4 
218 

110 
153 
177 
238 
214 
329 
lb4 
202 
TO6 

■ iroi' 

ro7 
193 
090 

014 



lb-- 




oil 


0Q8^ 


138' 


3*28 


2iO 


358 


159 


30b 


1 57 


2 58 


084 


043 


120 


3-2 


032 


085 


148 


loo 


152 


- 290 


073 


202 


220 


.283 


000 


081 


072 


-019" 


• 






TABLE II (Continued) 
Intercorreiations of post**test Scores afnong Items 



Items 


41 


"42 


' 43 


44 


'45 46 ' . 47 


48 • 


49 


> 50 


51 


• 










r 




• 






2'' 




















28 ■ 


• 








• 


\ 








29 




















30 
















• 




3 1 -« 




















32 




• 












/ 




33 




■ - 




i 








/ 




34 
















r 




35- 


* 


'i. 
















36 
37 














/ 






38 
3Sf 
40 




-a 


» 














A 1 

41 








* 












42 


. 046 


















. 43 


255 


394 










* 






' 44 


, 0^ 


454 


307 *' 




• 










45 


246 


258 


' 36o 


263 












46 


188 


.326 


.322 


3J.7 


400 


« 








47 


121 ■ 


458 


299 


596 


IM 294- - 










48 


" 041 


246 


239 


183 


, ZZ'^ 346 385 










■49 


' 0tr9 ■' 


2 67- 


110, 


260 


1:53 181 2 57 


' Z4a 






50 


144 


238 


367' 


189 


292 313 ■ 398 


233' 


176 . 






51 


■ 062 


24'6 


138 


179 


244 1.61 ^ 286 
232 147 A 253 


4Z8 . 


179- 


311 




52 


127 


34l 


269 


235 


179 


^97 


328 


464 


53 


136 


120 


175 


036 


138 ^095 , 022 
'120 fl93 , 139 


2S0 


• 135 


219 


388 


54 


. 


096 


106 


051 


200 


173 


219' 


302 



52 



o3 



54 




387 

210 420 



ERIC 



"14 



TABLE III 



Intercorrtflations of Gain Scores among , Items-'' 



Items 



*■ r- 


2 


3 


4 • 


5 




• 

7- 


8 


9 


. 10 


1 1 


' 12 


1 30 


• 








• - • 










* 




-OOZ 


053 






















-Ob's 


■ -020 


358 . 


» 














* 




03^ 


133 




-05^ 














J 




1'3- 


- '-148 


-012 


■ -051^02'> 








> 








04ti 


-144 


-043 


- 10 5- 


010 












V 




-00" 


-062 


-a8l 


-04~o 


0?1 




384 










014 


-200 


-087 


-Q51 


02- 




140 


00- ' 










045 


-0d9- 


114 


\/ T 


_=120 


OS * 


-034 


-044 


-044 








038 


103 


-140 


-07 9 


-134 


\\L 


027 


058 


-060 


-04b 






- 173 


0 ->o 


0 1 0 


'-0o8 


-059 




U o / 


- 1 U i 


c\C\n 
-U U / 


n Q n 
UoU 


C\AA 




oTT 


023 


-072 


-080 


-020 


-039 


-131 


-039- 


■ ,038 


-150 


■-099 


-07o 


-098 


008 


-OoO 


-042 


022- 


-012 


044 


08\ 


..134 


-086 


007 


-024 


-087 


008 


031 


-07=' 


-002 


-138 


04 5 


0<>1 


-004 


044 


-017 


149 .. 


.-050 


001 


-033. 


-017 


-0o2 


07^ 


-Ool 


*«fll2 


-025 


119 


.146 


141 


-039 


-08p 


-007*' 


-049 


0^1 


-O-^o 


2o4 


1 50' 


-017 


055' 


009 


091 


0'5 


^102 


- Iri7 


-117 


174 


008 


1 6') 


114. 


007 


-018 


021 


' 149 


0"- 


IbO 


-008 


08-t- 


04" 


-01 M 


-090 


-078 


-051 


149. 


106 


-014 


-005 


-0 34 ■ 


-085 


-i)p-' 


142 


04() 


.--0 66 


06'^ 


- 148 

# 


,-089 


-037^ 


-054 


-017 


.OB-1 


-098 


oq2 


-032-^92 


,012 


-0*5 2 


. 131 


014 


-027 


042 


182 


-090 


-064 


021 


083 


084 


-017 




.■H7 


-072 


1 19 


/02b 


077 


-01 1 


-045 


034 


-0 37 


■ 000 


081 


0<5^ 


; • 1 =)D 


.-039 


-004 


-00b - 


OS'S 


007 


■024 


0t)2 


-090 


-137 


-01 1 


057 


-031 


-096 


-027 


085 


-023 


-06B 


-097 


-042 


000 




-025 


053 


• 100 


-037 


03 1 


-0=>0 



1 

2 
3 
4 
5 
b 
7 
8 
9 
JO 

11 
12 
13 
14 
15 
lb 
17 
18 
19 
20 

21 
22 
23 
24 
25 

Decimal points are omitted. ' 
. Underlined cor r-elaf-ionb are significantly different from zero at-the 
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^ * • •• ■ . 14 



^ . TABLE III (Continued) 

■i0- Intercorrelati6ns of Gain Sco^res among Items 

Items 13 14 15 16 17. 18 ' 19 20 21 22'' 23 ' 24 



7 


. 




- 










• 




V 

\ 


4 






















5 




1 


■ 


» 














\ * 
( •• 

8 




- 






■ t 












9. , 
10 










r 






1 






1 1 




















/ 


12 






















13 




















- 


14 


439 
















• 




15 


020 


037 


















16 


-111 


-012 


1-39 


0107 














17 A 


-034 ^ 


055 


015 
















170 


.094 


"076 


010 


^99 












19 


1 12 


149 * 


.07 1 


-OMt 


B94 


1 14 


■ * 








20 


026 


,03 5 




-006 


^3-6 


049 


-042 . 








21 


-.085 


-066 


i090 ' 


080 


-069 - 


150 


067 


17 5 






22 ' 


'130 


073 


-070 


014 


-034 


083 


• 158 


430 


174 




23 ' . 


129 


053 


-080 


-057 ■ 


-012 


026 


183 


004 


OlO'^ 389 




24 


-016 


-068' 


-032 


-052 


-0 57y 


023 


07 0 


1 IT' 


031- 240 ■ 


209 


-25 • 


043 


• 016 


-186 


006 


-070.' 


098 


-034 


159 


047 141 


'179 259 



- .TABLE III *(Continue{l) ■ 4 
Intercor retations of Gain Scores among Items 



Items ' 1 



' 6 


7 


^- 

-056 


054 


-016 


-047 


0 57 


044 


-Z19, 


' 243 


174 


079 


118 


083 


-029 


\L-L 


-002 


-05'^ 


- 107 


-053 


*0 1 2 


, 043 


-085 


184 


047 


2J4 


rOOO 


015 


-01»7 


. Q2 1 


- 012 


-06Z 




/■ 


044 


-082 


018 


060 


' 0*22 


008 


-040 


115 


068 


083 


-010 


076 


021 


025 


08,4 


-058 


068 


104 


005 


181 


-165 


104 


03L 


' 07 1 


116 


-093 


-020 


-084 



8 



10 



14 12 



26 
27 
28" 
-29 

2kr 

31 
32 
33 
34 



37 
38 
39 
■^40 

41 
42 
43 
44" 
45 
46 
47 
48 
•4^ 
50. 

51- 
52 
53 
54 

a 



069 
■113 
048 
068 
021 



|2 
^96 
-087 
046 
3^ -157. 
36 .-147 



-160 

070 
-120 

-053 
07 1 
006 
067 
-063 
089 
012 
>02 
097 
-038 

■ 022" 
026 

-040 

■ m 



0-59 ^ 096 1 rO' 

-011^-0-54 -045 

6i6 003 -038 

- 197 --iOJB 029 

•016 -066 



- 182 

-128 
-046 ' 
-056 
-063 

1.24 
-060 
-Oil 

07 9', 

028 
-018 •' 

-02 5 
103 

-p.r6 

-007 
-049 

045 . 
-041 
-079 ' 
-019 
-100 



■153 -,083 
• 025 - 106 
■ 17 5 ' -015 
15^,-105 
064 



0-5 
-096 - 

075 . 

108 

02^ 
-039 - 

-022 - 
-057 - 

026 
- 054 

163 
■T2^,- 
-017" 
-•040 - 
■ 041 
' 027 .. 



■015 
095 
028 
061 

■103, 

■001 
■006 
002 
024 
022 
095 
0=V5 
■01%' 

i4r- 

•026. 



.018 -(M4--103 
-088 •■ -066 -067 
■ 039, • - 1^7 -033. 
'020'''-'-020 110 



-025 
089 
-119 

■ -045 

024 
-134 
-017 
-002, 

086 
-087 
-036 
-093 

136 

212 

061 
' 139 
144- 
-044 
061 
022 
028 
062 
^ 077 
' -145 

0*13 

137 
. 080 
046 



•'-001 
122 
-095 - 
193 

062' 
10 3, 
■ -025 

101 , 
064 

V 1562., 
" 0^43 
055 
1-19 
-010^ 

-023. 
069 

102 • 
. -098 
^'.056 

-02 5 ' 
038 
043 
051 
, .069 

104 
245.'' 



174 
033 



024 130 
•116- ^_80 
053 
023 
040 



»-169 004 



-MO, -057 

187 036~ -134 

084 -ai6 Oil 

056 ' -1)04 -059 



■054 
-040 
-696, 
■043 
-052 
012 
-C^3 
-003-' 
168 
057 



-004 
-102 
-138" 
004 
026 
131' 
002 
-128 
' 156 
081 



007 - 042 , 
■095 -034 

035 050 
000 . -OOjP \ 
029* .-024 

- 198 » - 1 0^0 ^ 
•Oil 069 
•006 ,-003 . 
029 -026.- 
060 003 

038 -090 

017 -021 

036 -108 
■013' -003 



■ 043 
0O2 

-026 

• 066 
065 
0 56 

■ 035 

■ 087 

■ 003 
.083 

• 059 
179 
020 
033 

■ 009 

• Oil 

■ 00* 
013 

099/ 
-005 



"0^0 
050 
025 
08(J 
.06'8 
241 
01 1 
-00^' 
■ 115 
087 

/ ■ 
■100 
063 
046 
117 
109 
051' 
03^' 
042' . 
'0^2 
0'18 



.090 -051 

- 185 07 6 

013 -IJl 

17 -005 



14j 



f 

13 



J?" 



, TABLE' III \ "(Continue'cl) 



Int^rcorrelati9iis of GainScor^ 
f4 ;"l5 " a -n 18.. 19 




• 23 24 2^ 



26: 
^7 
28 
•29" 
30 



Q62' 02'6 • -0?i5t-- 030 ' 
-140. . 041* .• 160 '" 00-6 
-134 ■ -05^ . -'So?- "-103 

025 -064 .-041 -098 
-108 015 „-&84,-03l 




'154*. ^0 54 007 
03^, -081 • 051 

-091 .-120 ' -040 
023 096 ' 6^1 
,70b8.'-1 53 .-031 



060 y *"-127 -095 i 065 . 1 55 
101 .-137^' 02'g .- 088 "1 
066 -055 r0'l9 ^ -105 . 

-014 ' 084 ' 04O 20 
084 lOj^' -077> - 
-,042 0^.. T'OftS- V 049 
•068 149 -030 / 086 
' 032 -073 033 -059 
' '-0!4d-^25 . 092 » a.17 5 ' 
• U3" -004 / 120 • 062 



034 014 
^4 049 , . 057 
1018 ' '150 




0-k6- -091 
Ib'l 019" 
6P9^20£ 
on /--0 51 
069 -^036 
.-154 -0,11 - 
-095 -024 
-23*9 -007" 
-'07 5 

O'l;; 



•^017. 
082* 



-015 
0 53. 

059 . 
.-0,06 , 

008 . 
-O^O'f' 

07 6' . 

219' 

-a90 

.•031 ' 



930 
'076 
lb3 - 

^099 
••042 

-089. 

0-65 
-032 
-006 



-048, , 
-094 

090 
.>82 

-026 • 
045 
039 
-083^ 
-019 
-102' 
.;934 
-01-1 
06.1' 
0891 



078 
'154 

-031 

044 
■ 021 ^ 

124 
■092 
■103 
■139.. 

016 , 
■635- 

\. 



2 -121 
020*. -It4.' 

,eo>-.r53 ■ 

068- -006 



• 181 - >44r">54— 
'.',0 55 ',167 -028. 
Vi90. > Wlf> 01 1 
,"0»12 ^94',: .039 

» * 



18b 
430' 

o\3 

• 08S-'*'- 
-024 

■185 
•773 ■ 
-Q35 

006. 1' 



051 
042 
-047 



-035 ' 

«r 

142 

-021 
034 
008 
037. 
• Oil 
-03^ 

-a 68 

08^ 
-023 
04*6 

. 023. 
038 
101 
'O'Sl 
.\d>7 ■ 

-01 1 
075 
010 

009 
-122 

-043 

-<B^2 • 
■074 
'086 



-035 

jo-ro 

059 
055 
056 



.148 
^03 



081. *055 
075 ■ 107 
086 060 
144 .003 
■ 060 059 



016, 
068- 
•035^ 
101 
021 



178. 



-079 
,0 31 -120 - 
091 1)34 - 
•-207 %^lp7 
-054 n_5 - 
- 184 -010 - 
-071^-JD7 5^- 
-0^4 017 
-109 -077 



050 075 

044 -031 

126 SO^'Q 

-020 -256 

-010 ,.057 



069 -081 
07 0 -063 



002 
152 
'153 



-032 
014' 
147 

•10^ 

• 065.' 

• 040 
074 

' 13'^ 



.-0"03-*- 
-022 

" 048 
-114 
-076 



-028 
-13^ 
-002 

106' 
-089' 

168 

OTT 
-047 
-027- 

09-9 



'-065 
0'22 
160 

. Yll 
i08 
016 

'23 1) 
12« 

-0 59 

. 0*44. 



07 5 • 
025 



-026**< 

083 
" 0.46 ' 

Oil 
-116 
l074 
-064- 
-U8 

044 . 



040 140 roi.9 . 

031 0*88 * 042 
-054 -129 043 
037- -124' 016 



TABLE m , (Con^ued) 
Intercorreiation^ of Gain Score.s among rtems< 



Items 



26' 



1 

2.7 



28 



29 



30 



31 



32 



3? 



34 



35 



36 



37 




•JJo 




27 


001 


28 ' 


147 > 


2Q 


-073- 


\ i.0 




3l 


-ooa 


3Z 


-12^ 


33 


-002# 


34 


• -031 


35 


IDS ; 


36 


.4 342.' 


^37 


1 17 


o o 

38 


1 d9 


39 


176 




-006 


41 • 


003 '. 


42 


038. 


43 




44 


-10®^ 


45. 


■ -068 


46 


078 


47 


030 


48, 


-049 


^9. 


, 103 


50 


028 


51 




52 


^01 ■ 


■53 


- 1 60' 


•54 4 













» 38' 39^-40 
1 ' — t 



139 

14J -040 



202 ^ --177 



192 • 214 



099^ . 084 
238 -001, 



-021 
■007 
079 
-07,1, 
-085 

•f' 

-04.4 -A- 029 
-006 -014 



014. 
-020' 
-.0g"6 
,-005 
•■-'643 
-087 



102 
■005 
033 
'114 
• lOa ' 
• 193 

(01 r, 

142 , 

rsi 068 

•117^ 154 
■128^ \\^ 

•215' I04O, 



029 
-004 
048 

r0^9 

229 
190 
TTT 
162 

072 

ioi 

s-025 
- 098 



128 156 
2r8 180 

-031 -08^ 

053 -029 

on -02*1 

-04'7 142 
030 Oil 
046 063 

'03 3 0b8 

-098 -059- 

-019 -031 

081 )ooa 

025 084 



Q51 
143 
082 
092 
187 



1Q4 
1 52 
104 
■ 118 
094 



-0. 



9- 

-035= . 093 
*19i) ' 209 
0TE--QI8 
■(P36* ^72 



X 



1 12 
1 51 
061 
• 172 
■ 08d 
- 19.1 
' -.1 54, 

WO 52 

002 
-0'>4^ 

*;ooi 

■027 
053 
-055 
-092- 
'-P38 
; 041 

-15^ 
' 068. 
-021** 

'0,17 



-046 
-061 
-061 
^ -042 
-061'; 081 V 
028 '061 



00i-» 

132 < 14-0 
0 36 -'in -,07 3 
104 -005 
077 -059 



■ 169 

124 082 



■094- 

■006 
068 - 
1|2. - 

^037^ . 

■ 020^ 

■o4i •- 

■020 *- 

■ 103 • 

?30- , 



063^ 013 
126 157 
074 036 
0^2 -018 
063 -138 
006 . 125 
059 151 
i(pO ^017 
Wibm 003, 
04ii^ 045* 



•077 d07 040 

286 -613 .'-104 

134 -106 

•-OIO'* 0-72 , 01'2 



-'010 
■04'5 
097 
045. 
07 I. 
'048 
-013 
-153 
,065 
J 52 

-063 
-088 

;030 
)028' 



082 
-02f 
-066. 

052 

066 
.209 

03^ 
-033 
-051' 

ao5 



-l46 
070 
009 
-1.02 
-055 
- 1 46 
b68 
093 



120 
07 5 
231 

-025 
032 

■034 
143 
055 



r013 -089 
-015 140 



-212 246 021 
-045 T|5 *b'98 
0^2 1-07 3 . '081 
06^^ ;<t)48.,127 



TABLE lU .>, (Contihueti) 
Intercorrelations of Ga,i,n ,Scores afnong items 



i 



Items 41 



42 



■ 43 44 



45 . ; 46 . 47 
r> 



^8 



49 ■ 50 



51- 



52 



53 



.26 
27 
28 
29 
30 

. 31 
. 32 
. 33 
34 
• 35 
36 
■37 
'38- 
39 
40 

41 



ERIC 



> 



42 . 


-07 1 
















43 


07 6 , 


'277 














44 


-0J9 


, 178 


14n 






1 






45 


1 =^7 


010 


2t.t, 


'in 










46. 


0 50 ' 


00=1' 


027 


Q')4 


ir? 








47 


'OH 1 , 


lb4 , 


082 


084 


zoa 


.220 






48 


-113, 


.—013 


-0-8 


093" 


Oo9 


185 






49 


-ObO- 


-0d4; 


-02 1 


047 


024 


104 


* 100 


' 134 


50 


00 1 


-Obt - 


14^ 


lOo 


003 


O^b 


17 1 

• 


. -064 


51 


■1I34 


-08b . 


-014 


0 I'T 


» 

-,07 


-090 


021 


,"159 


52 ■ 


-tm2 


-129 J 


049 


093 


09i ■ 


-ObO 


04b • 


060 


53 


, -022' 


-0 52' ' 


-053 


0 34. 


-07 => 


- 12^ 


- 177 


- i.rs 


54 


oaa 


• -•02(#' 


003 ' 


-0 10 


-058 

f 


1|05 


-120 


-093 



^123 
0*31 

12i _ 
'087 147 ■ 
"'0 5 { . 205 * 

r . s 



\ V 



192 

^03 ^ . 30b 
■ 127 
# 162 



181 '345' 



V 



r" 



■TABLE IV 

Intercorrelation^s of Teacher' Ratings of Items* 



Items 



. 9' 10. 11 ■ .12 



1 

2 
3 
4 
5 
',6 
7 
8 



9 

10 

1 1 • 

12 
13 
H 
15 

16- 

' U 
19 
20 

21 

22 
23 
24 

: , 25 



304 
110 

TOO 
-2X0 
078 ' 
093 
080 

- 015 

4 

,295 
223 
-ObS 
-OFT 
2T5 
320 
-093 
-Of2 ■ 
!295' 
316 



306 
265 
253 
350 



357 
333 
402 

ILL 
454 

373 
193 

•V? 

499 
391 
290' 
198 

30?" 
289, 
196 
345 

284' 

' .4 

184 
'314 
37 3 
3 58' 
119. 



689 
373- 
193 
S3 2 
606 
,^42 
278 



413 

20d 
562 

6 IT V 
147 

354 




421 s 

523 190 
47 4 260 
2""l 3 . 0^3. 
276" »a28 



402 y 394 
189- 34 5 



454 



238 
2,7 8 
27 2 
16-1 
T59 
197^ 
190 
172 

052 
243 . 
253 
5L6 
125 



314 
37l_ 

288 
340, 
342 

•223 

^264 

24-1 
19s. 
233 
4'93 . 
146 



. * Decimal points ^re omitted. 

Underlined corr^lationi are non- 



172 

m ■ 



2^ -ft 

. 109 0€7 
'37a' . 212 

lli 
■125 



301 

081- 

032' -113 



TT(J 
224 

1 

129 

106 " 

344 

627 

186 



Ibi 

269 
654 
,410. 



190 
297 
?64 
12s 



107 
225 
234 
^52 



2S ^ . .^3 



220 164 

>304^ '227 

.349 260 

306 319 

■039 G81 




152 



i249 
'40d 
, 524' 
'^16d 



603 
593 
305 
541 
428 
494 
424 
364 

342 

323 
377 
130 



bignific^ntly 



different "from .zero at the 5% level.. | 



Items. 



TABLE IV ; (Continued) ' * 
Intercori^elat,ions' of Tekch'fer Ratings of Items 



1'3 



14 



15 • (li 



4 

17 



18 



19 20 



21 22. - 23 -• 24 

1 * 



25 



1 
2 

3 

4'- 
5 

^6 
7 
8- 

. 9 
10 

11 
12 
13 
14 
15 . 
16 
17 
18 
19 
/.ZO 

21 
22 • 
23 

25 



745 ' 

317 

373 

623 

622 

24^ 

244, 

132 . 
22^ 
18'8 
193. 
-169* 



301 
428 



543 



539 • 267 
585 31 5 



331 ■: 

344 J 868 



.334 405' 531 
353 43 5 ^ 587 



J 76 287. 



259 ■ 229 
2^ 3^5 
. 454 
'-Or7' lb8 



41*4 '^228 
3<)8 |#9t> 
442 pi 03 



» 







« 




























374" 








334^ 


765. 






230 


597 


.682 




345 


■ blO ■ 


577'' 




312 


600 , 


619 


469 


11)8 


. 331 




" 136 


077 


. '296 


313 


417 




15o 



237 • 433 ' 

146 r3bl ^ 30! ■ . 



(J .V-/ 



TABLE IV (Continued) 



Items ' 



1 



Intercor Relations of Te^a^TTer Ratings of Items 



■ 9 




^10 11 



'26 . 
27 
28 
29 
30 

31 
32 
33 

34, : . 

•3 5" 
36 
37 
38 
39 
40 

'41 
42 

43 . 

.4-4 

-45 

46' • 

47" 

45 

49 
•50 

51- 
52 

5>; 

54 



ERIC 



327 

356 

346- 

403 

32.4 

237 

194 

234* 

ill 

451 

• 362 
437 

- 201 
530 
37 6 



Z95 

226: 

.177' 

309 

347 



187 
' HE 
208 
368 
39« 



260 548. ' J 28 
357 46? -^^91 
330 391 282 
249 
249 



'479 509 
432 520 



42 5 443 
291 . 27 0 
348 37 6° 
380 ^436 
393 281 



393 
480 
410 
483 
554 



291 
314 
331 
250 
308 



540 601 232 

307 387 090 

540 509 J_88 

518 /392 £]? 

251 503 -206 

527- J_84 
501, 



320 
3t0 
371 
27.3 
385 



1^4 

Vl9- 3T5- 
509 ' ^204 
■615' '262 




•397 
366 ' 
260' 
438 
449 

5p9 
374 
42 5 
47 5 
391 
•4Q9- 
483 
.513 
531 
•■527 

'562 

599 
^7 1 

430 

2.76 

408 

320. 

161 

222 

695 
621 
253 
489 



345 


' 172 


'163" 


412 


444 


18'6- 


128 


405 


268 


059' 


-024 


■329 


466 


•131 


, 192 


• 494 


•452 


. - 312 -- 


314 


503 








^ D D 


397 


^09- 


iZb 


^468 


52.1 


^222. 


280 


, M37 


502 


359 


340 


^440, 


391 


292 


147 


^81' 


4d1 


3t)6^- 


Tl9 


614 


' 381 


- 


205 


. 59^ 


,420 


' .407^ 


218 


578 


395 


329 


240 


304 


407. 


359 , 


.287 


56f8 


490 




47 2 




o21 


407 


316 


' 547 


537 


- .294 


321 


407 


4^.9 


209 


..247 


47 3^^ 


390 


162 


157 


440 


27 5 


205 


1 5'3 


• 404 


302 


435 


389 


450 


181 


230 


• life 


394 


242 


130 


01:4 


221 


a301 


133 ■ 


^9T 


» 320- 


598 


■ 319, 


316 


643 


. 543 


331 


30*0' 




39-3 


•366 


204 


317 ■ 


41^ 

* 


335 


307 


482 



12 



« • 



290 

2 3» 
189 
290 
341 

3J3 

343 

298 

3o7 

295' 

322 

325 

389 

300 

419 

285 

328. 

375 

3il; 

318 

296 

293 

174 

235 

42'9 

3 52 
369 
299 



TABLE IV (Continued) * ' ' 
Intercorreiations of Treacher Ratings oi Itemjf^ 



# 



Items 



13 



14 



.16 



16 



17. 



18 



— rr 

_ 182 .125 
J 0.1 
-0^ 



• iT 


< - 

20 


21 


i Do 


^ Do 






3 :>o 


"i A A 

24^ 


1 A 


A r\ \ 
4U i 


/I 1 n 

^_1 _U 


1 An 

D OU 


1 A c 
3 0!) 


^ 1 7 


A \ A 

414 


4U 




9 /I o 


1 ' V 


U 3o 


i 14 


3U3 


1 /I Q 

1 4o 


243 


212 


124 


447 


384 


267 


355 


282 


.20d 


336 


263 . 


1 d9 






J "7 "> 

^7 4 


539 


A A 

434 


4 1 o 


O 'L /I 

3o4 


A I'} 


39^ 


4o4 


/< 1 "7 

417 ' 


.inn 
' 3UU 


Z80 


1 67 


0'42 


o o 'i 

333^ 


226 


r\ o o 

. 088 


3Cf8- 


. 269 


2'l0 


3i^ 


. 244 


-189 


4Z2* 




222 


4 3il 


J D i 




454 


■> o o 

288 


^ 1 u . 


4<ib 


■J /I o 

34o 


7 SLA 


266 


^80 


337 


234 


360 


307 


34i 


i 

292 


162 


37 1 


2.94 


T78., 


491 


406 


517- 


.398' 


262 


-262 



2^ 



23 



24 



27 

28 . 
29 
30 . 



204 
125 
- 02^ 
223 
198 



159 
231 
025 
255 
263 



4l8j 

451 

269 

49ri 

467 



•32.1 
379 
323 . 
423 

.483 . 



209 ' 
•048. 
182 > 
282 



193 
223 




511 ■ . 353 279 '^3' 445 288 

52r . 274 262 353 43i 283 

53!4 V2'20- 316 232 ,318 329 

54<V N.12 .2"60 ■ 198 '2 34 152 



242 168 
280 .. 202 
294 .218 
380 374 
122 014 
179 . 0.72 
228 W 1 15 

JR 
222 



144 
TS5 
144 
044 
132 
085 

jm 

029 

02^ 1 

022 

18^ 
241 
328 
130 




0S3 
JoE 
155 
T55 
135 

TTo 

1^2 
2,93 
193? 
31?: 



087 
TO 
JWB 
lib- 
1ST 
, 194 
I 241 
259 
! 247 
] 183 

I ... .111 — 1 

I 211 

^88 
^4'53. 
/ 302 



327 441 -270' 

355 '418 290, 

3A2^ , Aft* l412 

337 ' 59.0 284 

488 543 349 



312 
37 0 
327 
283 

-316- , 
■ 3te ' ■ 

349 

443 

366. 

457 

301-' 

360 

327 

268 

364.- 

308 

311 : 

37 5 
26.5 
353 • 

.341 . 

328 - 
'386' 
.2*96 . 



600 
456 
539 
389 
425' 
456 
414 
47 0 
450 
576 



141 
781 
130 
078 

m 

304 
285 
292 
^74 
•223 



45r' 108 



57-3 \ 1 04- 



573 ^ 
453 . 
403';; 

42-5.; 

456 , 
401 ' 
,i7i 
310.1 



179 
1^7 3 
.280- 
386 
278 
'420 
4i8 
421 



650* i ,"219. 
589 ; '209 
200 i j'202 
4,7 1 ; ,313 



TABLE IV (Continued) 
Ifttefcorrelations of Teacher Ratihgs of Items 



... Jt-ems' ' 26 



27 



2"8 29 



30 



32 33 



34 35 



36 



37 



38 



39 40 



26 

27 , 563 

28 423 

^ ^5t^ 



437 



— 


'^7Q 






623 


49-1 


7 12 




>90 , 


399 


713 


-616 


481 


367 


510 


5.90 




345 


68 1 


5*86' 


441 


288 ' 


554 


482 


552 - 


'.517 


47 6 


503 


^6b 


"468 


483 


480 


5.1 I 


423- 


43 1 


4:Z9 


385 


526 


409 


* 492 


452 


419 - 


.448 


480 


^7 3 


41"! 


527 




473 


303 


'502 


551 


^31 


291 


495 


55b 


466 


400 


464 


• 490 


472 


396 


413 


403 


495 


'288 


47 7 


490 


413 


331 • 


37 5 


42''9 


276 


276 


. 307 




291 


362 


3-60 


42 1 


399 


339 . 


350 


443 


442 


■ 482 


432 


536 










523 


3 39 


593 


'581 


514 


317 


546 


561 


273 


278 


147 


39| 


32 5 


305 


410 






• 




> 



30 
31 

3:. 

'33 

34 
• 35- 
36 

\ 39 
■ 40 

41 

42 
43 

4>r- 

, 46 

'. 47 - ' 
48' 
49 • 
50 

51 * 
* 52" 

53 
' 54 , 



.610 

. '510 
* 431 

468 . 

.332' 
57 9 
532 
550' 
4o0 
■'4-44 
'524 

' 514 

476 

470 

505 

444" 
■ 37 5 

353 

^ 

\244 

■^•67 
\ , V 

490* ■ 
^41.9, 
212 ^ 
325 



b4fi 














• 






1934^ 


: 5,67 


673 
















#7 


^^6 


• 














51-5 ' 


518 


401 ■ 


343 














576 


513 


498 


421 


888 






« 






553 


486 


470 


362 


789 


7 55 • 










453 


37*1 


388 


480 


o83 


530 


53b 








439" 


38b 


412 


340" 


5i I* 




594 


• 520 






517 


52ti 


522 


454 


b22 


b26 


b3 6 


' 5i0 


713 


* 


554 , 


403 


5*14 • 


393 


648 


b51 - 


646 


381 


. 542 


b04 


574 


•466 


530 


425 


" bl3 


63 1 . 


ol6 


, 4^)8 


^9b , 


080 


570 


^93 


514 . . 


■ 422 


5ZZ 


*'5b9 • 


521. 


^48 


o52 


b37 


486A^ 


313 


-380 • 


3 lb 


616 ■ 


593 ■ 


559 


524 


5u9 


5o2. 


466^ 


42JMr 418 


359' 


578 


562 - 


•568 


398 


444' 


542 


368 


31.5 


367 


27 7 


- 51 1 


513 


518 


■•3)7, 


427 


506 


^0 ^ 


»407 


337 


32'5 


5/2 


504 


487 


500 


4o7: 


50 0 




2U1 


280 ' 


215 


47 3 


.450 


430 


442 


454 


482 


288* ■ 


21,7 


? 370 « 


194 


Ibl 


310 


;35b 


262 


' 376, 


328 


315 


353 


377 


. 36Q 


'5Z8 


49?N/ 


413 


' 384 


4b7 


■352 


692- * 


466 


675 


552" 


-.613 


626 


606 


494 


oil' 


lb89 


585 


4 30 


392 


616 


534 


556 


532 


532 


543' 


659 


#89 • 


2 30 


■ 182- 


400 


323 


308 


309- 


57 1 


•■ 202' 


,3 1 4 


^453 " 


2.9.5 


425 ■ 


434 . 


398 


433 


522 


543 


^ 39i' 


M57 



TABLE IV (Gontinued) • . , . , 

. , •• _ Intercor rel^>ions of 'Teache*- Ratings of Iterr^ 

'* " - ' ^ .V 

Items 41" 42 -43« . 44 45 46 - ' 47 .,48 49' 50 -v' 51 • 52 - 53 



26 
27 

29 
30 























































I 












• 






< 










• 














35 ' 


1 


\ 




















36 




A 












4 








38 
39 

46 •" 


• 


} 


• 




• 






1 








41 










- 


> 












42 


889 
















■ 






43 * 


620 


674 




















44 ■ 


627 


b=»3 ' 


7t)9 










• 




• 




45 


6 J Z 


639 


b 14 


6 1 Sf 
















46 




4^9 


490 


















-47 


437 


494 


4o4 , 


^OQ 




^31 










48,' 


334 


33$ 


409 


47 s 


377 


^18o 


791 










49 ■ 


243 




399 


37^, 


37 8 


=.68 


41=. 












381 


36? : 


- 428 


36 ti 


/ ^32^ 


330 


37 1. 


40d 


■ 497 








686 


698 


7 00 


soi 


' 638 


=.13 


- .516 


46 3 


• 389 


'47i 




52 . 


S7 5 


' 6=)^) , 


69 




h-S2 . 


436 


5f6 


.403 


•365 


530 


807 


53.. 


213 


28^ ' 


299 ' 


302 


' 18.1 


Z62 


• 365 


235 


283 


: 3-49 


2ol 




397 


449- 

J 


401 


477 

i 


283 


285 


501' 


388 


380 


;^27 

s 


473; 

1 






} 

f 

i ' 


\ 


• 


« 


1 


« 








ERIC . 




V 




1 
1 


»•* 

■J 













356 

520 461 
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APPENDIX B 



THE 



QL'E,S riON'NAIRE " 



FOR 



TEACHER^ 



1 



t. 



1 



1 



\ 



it 



i 



1 ^ 



■ j' 



i i 



Namev__V [ ] ^ Male Female_ 

Circle the numeral corresponding to the chaptej-s in the new UICSM 
Course 1 test that your most advanced class is now studying/ " • 

1. - Z. 3\ 4. 5. 6. 7: S:, 9, 10, ^ '. 

» * ' • . '' ■ 

How many years have you taught* mathematic s years since. 



How many years have you taught UICSM Units I and II (previously)? 
years'. * v • 



When did you last teaeh these units? F^.ll "Spring 

Have you taught other UICSM units ?• Yes Nc l^ 

If Yes,, what units have you taught'^;; * ._ 



Have you taught any subject other than mathematics? Yes ^ *No_ 

If Y«es, what subjects have^you taught? - : 



How many courses have yoii taken ifie-which you stiidi^d tne contents- of the 
UICSM curriculum? . ' • • * 



Did , you attend any summe r institute s bn' the UICSM , cur riculurri ? 
Yes No If Y(^s, m wi^^t ear(s) aid you att&nd7_^ 



Rank the following phraseS'^accoiriing ro how cioseiy they 'seerh to descy^ibe 



esCsTioe 
r thf|( 



the abilities you stress in teac hm^ UICSM. Course 1. Mark fo 
/nost important alpilitv. 'Z'^for the next and so ort to the, least important 
ability. Please do not ortiii any items and do nc^l give a tied-ranK. 

^kill ir\ nunfJerical c^mputeition ^ . - . ^ 

Skill in symbolic nia'nipuicLy.on 

Remembering rnathemati<:ai orinciples 
Understanding mathe'njaticai < oucepts' 

Discovering mathemcitical relationships 

Deductive roas6ninu • v /, 

. ^ . . . -I 

Generalizing from concrete objects to abstract ideas ^ 
Applying' mathemat'iral skills to r,eal life problx^m^' 



i 



To^ help us get aii overall picture oi how teachers would like to have tests* 
/constructed, please mark ekcb ot the following scalps. Mark e^ch scal^ 
to indicate the proportion of items of the two kinds indicated that you would 
like to see included ,irt Course -l tt sts for grading purposes'. 

^For example,' mark Vc^ rirst scale to indicat-^ what percentage of relatively 
easy items, as' compared \Mth relatively difficult items, y^u would like to 



ha^mciuded. — Manrk^rhe s^ccond-s-trale to 4 ndit^a-te.;what -percentage of . 
multiple-choice items, as» compa red w ith completion ke?^, you would lik^ 



have. Mar-k each scale wiU^^^ '\* as shown in^the'^§ample bclo>X^. 



(Sample) arithmo^tic [_ 



0^0 



algebraic 



100%- 



(a) 
(b)^ 

\ 

(d) 

(1) 
(g) 

{.)' 
(J) 

(m) 



re hat 1 \ clx 
e a s V 

m u 1 1 1 p I'e - 
. c ho ice \ 

ve rbal ^ 
man\ *worcib 



iann 1 la 



c omputat.iortal 



teacher 
const rue ted 



0% 



st rai ii.M - 
to r\\ a rd 

i 



re a s o n 1 n o [_ 

/ 1 i C)f^ 



0% 



9 ^ ^,n<j' 



I i 



J rc"lati\ ely 



100% difficult 



_^ completion 



100% 



—I 1_ 



100% 



100% 



100% 



non-\e rbal 
t^*\\ words 



C] u 1 r I-' 

' t r u k V 



uniani 11 la r 



appi led' 



1 



ahst ra( t 



men 



_{ ( one cptijal 



^1 ^D^o 



100% 



loo<V„ 



recall 
defliu ti V e 



UICSM proj 



. 100% constructed 



IGJ 



1 1 



U$ing'the scales below,' :^atc dli.of items of •the enclose d I , jd 

Indicate i^liur ^ting tor e^ch b\ *placrng'an'\x* in one o£.the 10 boxes ^ ^ 

*of the»scale co r re sponding, to tho. iU^iu, Mark the'box.on each scalf?. which ^ * , 

indicates how good the'item woaJd»be, in ^bjA'iS^opinio'h, for ii*iclusion in>a ^ 
test to b^^iven at the" ^/id of fHe urst thr»ee chapters of the new ^UIC^M ' ' ** . 

tfe^ for ^Purse oVie^ . ' v * * ' ' ^: 

^ Every item exifept^ Np . ^ S and No. tj^has foun sub-items, 'You should 

ignore differences betwee/i the sub-items of a gi"teVi item af^ rate e.^ch ' ^ 

• item as a whole, ^ ' ^ • , . , 

Plpctse,-do n"ot omit anv itc*ms. • li can; describe tHe reasons Tor yo^r 



rating breifly^^do so in'the space ^"^^^l^i^d at the* right of, the^^ating scai.^ ^ 



Item No\ ' * o • - * . Reasons 



worthless' inferioY ^^^'^ g<>%d" superior periec'^t' • 



■ . • • g g.g g .g^'g^g ' q^-gp . 



Ep.g'^^q-g g . ^.g p 

"wortfilejis o^ferior suf)erior per'tf^c^ 



. t 



4 



^ - , , . _ . .... 4 

■ ■ ; ... • : . . g ^ g g. y-;- 3^-- 

. • ' • . . ■' " • • - ' . ' • \ - " ' M ' ' 

' • >' • Sr ' ' ' • • . ■ • . ' . ' . *v. , ^ . 



isitem'.No 

. 9: 



V 



J^g^ ^^^^^^ 



'a 



0 ' 1 



Reasons 



i 4 



.7 8 



• worthless infe rjo^ ^ ' ^ ' ' " 

•vmK. ■ 9 1-4 



^good superior- 
3 4 '»'5 . 6 7 




perfect 
9 



. ■ 0 1 2 *'"'4 =^ '6 7 .. 8- 9 

?' ■? P ? Q ? ^ ^' 




.4 



is. 



-ft' 



17. 



18. 



19. 



10. 



ERIC 



3 4 . 



\j 1 * ^ ? -i 3 u '7 8 ^ J 



• u / 1 Z - 5 4 . S 6 7 8 ^ ^ ' 

y p y p 9 p £p .p p 

0 ' 1 . ' Z i A ■■>' '7 8 

□ t^'O [:p.q 'p 



w'orthle»ss infeVion 
0 ' 1 * 



' good supe ridr 



pe rf ec t 
8 9 



. ^^P ? p-^. p o 



0* M ' .2 



4 ,6 6 



-p Cj3--S p P P P 'l^, - --r: 

0 1 *2| ' ^ 4 ' S ,*. . 7 -8 . 9 * ■ ' 



'J 




-a 



altem No, 



m 



' ■ ^ 0 1 2 ? 4 S • 6 



7^ 8 



n zi 



/ . , * worthIess^ irtferior j;<Jod superio^r . ^ . perfect 

3 4'^ b 7 ' 8 9 



r 



0- 1 



. 6 



0 1 2 5 '45.6 7-8 

y -q-cp g .cp p.^^-g p [-]. 

0 1 Z ^ 4 o . '6 ' 7 8 9' - 

? ? ^ ? ^ ^ ?^ 



Reason^ 



O^e rail, racing- t-Ho\s tioe^i is 1\ ,->t \'* 

a M 2 ^ -4 - ' ^ 



worthless inferior <i.^o>d 



supe r lor 



i.iSt *tr<.' rt in oris 'or 



f^e r fe( I 



\ 



4 



A 




•4^ 



4^ 



4'' 



IG 




IF 



1 



12. 



Using the scales* below, ^ rate all of^Jhe items of the enclosed T^est 11 . 
Indicate your jg^hg Tor each, U^i^rt *by pl4ci*ig an *x!Mn one of 1^ .J^Oboxes 
oi-the Sf:2ile curiae sporrding lo'thtr ijfca^. . Ma^-k the bo:k'on eacK s'cale^WiuxJr 
ii>ciicates how good t}}^ item. vvbuld*^ej in your opinion, ^or inclusio^ in a 
test to given at the enfi'df ghipteV^ 4 alnd 5 of the new*UIC5M te^ct for 
course one. v t *' \ ■ ^ v ^ ' « ^ 

Every item except No. 19 has four stib-items. .You shotild rgnore differ- 
ences between the sub-it^emb a gi ven;ii|^i>i and rate each item 'as a whole. 

^Please, do not omit any item's, ^f a ou can describe^he reasons for your 
rating briefly, do so in the space provided* a^t the^ignK^the rating. scale. ^ 



Item No> 

/ • . 0 
- 1. 



0 1 5 2 4 ^ ■ ■ 'h 7" 8 



worthless .inferior 



gutid 



supe nor 



perfect ' :^ 



1. ■ "2 , .M . • 4 5 - 



2. 



7 . 8 



1 * 



^ 4 < S 




.9 



0 1 



* 8 



1 2 



8 - 



^perfec > 



wprthless mfeVior 



.supe r»o r 



7 . 8^ ' . 9 



4- . 



I' 



'8. 



• 0 ^ ' 1 •' "2 4 . S 6 7 8 . ■ 'I / • 



• . " ' r 



.3^ . 



ERIC 



. n -• 



•.•^ .-0 i Z i ' A 5 6, 7 



V I 



ERIC 



wortt^less inferior * ^pod superi.or. 



.0 I Z --S 4 .5 «^ 7, 



Reasons 



8 9 



perfect 
8. .9 



11. 



12: 



1-5. 



b, i ' , i > ' 4 ' 5. '. 6 •• 7 a 9 



0-1 2 ^ ^ • 4' 5 6 7 8c: 9' 



.0 .1 



7. '8 



14. 



w(3rthless *inreTi''o^ti^jv'gt?Q|j '*siipexibr perfects 



16'. *^'L p 



2 i V ' ■> 



pe r 
8 9 



17.' 



18. 



19. 



20. 



': o-'-' 1 '2 -'^ ' 4 • • S- • " 6 . 7 8. "9' . .' - 



4 -Vi ' 6 f7', 



0 1 2 3.4 S .,6 7:89 - 



1 Go 



i 



Item No, 



3 - ' 4 



Reasons 



worthless iftferi©r£ good/*- -superior perTect 
. , . ' 0 1 2 ? 4 S ' 6 V 7 "8 9 



-'22. 



0-.? 1 



^ , 4. 



6 ■ 7 



24, 



'2C 



27. 



29. 



0 1 



S 6 7 8^9 



0 1 



worthlt^sfi inferior good. superior . 



rfeci^ 



•t)' ^ 7 



y .q cp q :p p cp. q q » ■ 
? 'q y q ^ q q y, 

0 1 2 ^ i 4 \k ■ .1 8 9 . : ■ 

. ;^p-?>^p 9;?:^ '-?. - — 




Overall xatin^^ (Hovr*aQpd 1^5 Test U"^) 



0 . 



U'Orthless . inferior nood - superior 



JIM- 



pe rfedt 
* * * 

(conti'nued)) 
s * 




TEST I 



I* 



Sampie^tems / — 
ProposecY \ , ^ 



Chapters h - 3 
Qf '' 

Hrgh Scho(^l Mathema'tics 
- . Course 1 



D. C. Heath, 1964 




V 



3ingle quotes, * are used toj^set off a written or printed symbol (word, 
ntimeral, or other expression) about the symbot itself jiistead of the^ thing 
*it represents. ^ ' \ . * ' 

(Examples) Ada is taller than Penelope but *Ada'' is shorter t nan • 
* Penelope'. 

*3' is a symbol that represents or names the number 3. 

It makes no sense to say that . 0001 is larger than 3. 
, , But * , 0001 ' does take up ;Tiore space than *3' , 

Circle the%tter iiyiicating the sentence which makes the most sense. ^ ^ 



B 



B 



B 



B 



C . 



D 



D 



(a) A. " Mary is a part of Maryland. 

* Johfx' ha^^a letter. John has four letters. 



B. 
C. 
D. 



I have trouble with my pen when I make a 3. 
He erased the *5' and put a *4' in its place. 



A. 
B. 



5EPT. 

6 



The calenSer has the number 6 on it* 



*11 -f 3' is NOT-the same as *2 X 7\ 
32 

The number j-g- has* a numerator, a fraction-ba: 
and a denominator* , - 

There is a *five' on the slate. 



(c) A. *4' is an even n\imber, 
B. "^4' is a niimeral for 4, 

' . • 4 is not. a niimber'.^ . 

rD. 4 is a numeral for *4'. 

(d) . A. 2 + 2 is the sum of *3' and '1\ 

B* *2 + 2"is thfe sum of 3 and 1» 

6. 2 + 2 is a name for '2 + 2'. 

#• D. ' 2 + 2' is a .name for 3 + 1 . ' 



i 



Let us agree that the number *2 measures a Z-mileis-to-the-east trip. 
Then "2 ^measure^s a 2c'mile trip in the opposite direction, Fill in the 
blanks to make the statements true. ^ ^ 

- [Gj^B [j] [p a l|I [f.i F^i 1^ I'|J' 



(Example) A trip from D to^ E is measured by 

(a) A trip from I to B is measured by . 

b) A trtp froiq^i E* to C i^ measured by 



trip from A fo F is rVieasur-ed by 

4 

trip from L to H is measured by 



'East 



Fill in {he blanks td make true serttences.. 

(Sampl^)- . . *3 -+ -4 = Jj^ 

(a) +'*8.J = 



(b) *4.3 + ^5.9 = 
(d)-'i+'i=_ 



.4, Fill in the blanks to make true sentences. 



(Sample) *'8 + 



0 



(a) -3. 2 + 

(b) 



= *3. 8 



2 



(c) '2 + ni .= 



+ 11) 



'(d) rs + 



= X8 - 3) 



\ 



V 



s 



4i 



^ 



. •17, 



erIc- 



4 ^ 



5: 



-J I 



no 



Suppose that a trip- on a number line from point A to point B is measured 
by and ^a, trip from point B to point C is measured by /10, If t)ie'iyoxnt' 
A is *7, what real number is point ,C?' ' Circle the correct ^answer, » 



(A); ns 



(B) '^4 
? 



•(C) .^3 



(E)- -4 



6. ' 



-6 



+2 



D 



+8 



\ 



/ 



A cyclist and a hiker. both. star,t moving at the same time arrd in the' positive 

direction. The cyclist starts at A and the? hiker stftts at B. Gn the 

nximber ilne al^oVe^ w.hich can be used to repVesent ]^e rAovements of the, 

cyclist aftd hike^, point A is located at "6, a^d point B at *i. T'he tyclist - 

'passes the hiker at -C t^6), continues in tne positive ^direction unti^ he 

reaches a tertain point B (not 'shown) af which, time 4ie de,^j^es^ to return^ 

'tp A. 'As h^' returns, he passes the Jiikejr at D (^8).- U both travellers aye 
\ ' . ■■ , ^ 

moving^ at steady rate^, -what is the location of the point E' kt which the . 

• ■ . '6 ■ . 

cyclist turne'd,? Circle the correct answer. " 

{4) *9., (ti) /lO \(G) ni . (.D)V12^- (E) /13^ ■ 



m. , 



ERIC 



{ 



Fill in the blanks' to make/true^ipentences^v^- 
(Sample) ■*b\_^_=*lO 

(a) • -3 = ns 

(h) X-7 = -21, _ 

^' ' ' M . 

(c) . *3 x_ '= -r . , 

(d) ' >i-"3 =0 ■ ■ > " 



Fill in the blanks to make true sentences. _i 
(Sanjple) ' X *4 V^- - " »^ 

•(a) -100 X *| =?. " • ^ 

..(b); -5'x ' ' i • , • , 



, (c'O (*2'X -3) X '4 = 
(d) -6 XCE X-B)- = _ 



a. » 



49^ 



9# g^xnpletfe each line , by the expreAsions given to show the cpnveimon^l 
.^^'o^der of performing the operations,. ' ^ 



■ •.3 + 5X2 = 3 "K^j^AJ^*- 



(b) 2 x ' 4-.- 3 = : 



. (d) 12 -:5 X.2 = 




9. 



0- 



10* Fill in blaiiks to miakctru)? s^jntences. 
,« /■{ Example.) - Z-X/5 X«8' =;" " . • 
' (a) 3 )^ 6 - 2 X 5 .+ 2 =" » . 

■ '(b) 18'- + 6-) ; 2 = ■ , > 

(d) rS - 3^j8 ■?4X/2).= 



0 




I ... - .J . ^ ^ 



6* . 



u 



Fill in the -blanks to make true sentetices. 
(a) 19. + _^^ =72 + 19 

2)' • . 




(b) 3) +• 2 =n.6.+ {_ 

* . \ ' 

(c) 2 X 7 ^-h ^ -X f -• {2"t 3) X -7 

(dV y<\5 + 8y ^ ( ". J + 8) X 4 • 




4 




12. Htere are five principles for real numbers; ^ ' 

s (A) Gdmmutative principle for addition {CPi\) 

(B) c Commutative principle ^or nniult^plica/ion {C?M) 

[C) Associative principle for addition {APA)» 




' *(D) Associative p^-inciple for multiplication l[APM} ' ' 

» (E) Distributive grinc'iple for fnultrpifcation oyer addition (DP^wIA), 
a ' * ' ' ' ^ 

• £^ach of the following sentences is an instance of one of the principles^ 
.lis^l^ above. Circle the, correct letter to i^ndicate the principle wKich is 
' used. • 





B 


.c 






B 


" * » 




•A 


B 


. c 


' D 


A.. 


« 

, B 


c 


D 




E 
E 



= (9. 837 X 317. 589) + {4- ^52 X 3l7. 589) 

(b) '{1 '+ "4)-^ {£/X-l'7) = (1 + "4) X 6 X --l? . 

(c) n7 +-{"12 + -9) =i {:12 + .-9)'+ *17 

(d) (l-i)x(i+|) =^li+.|)x(|--i) • 




13. Fill in the blanks to make true sentences. 



. ■ (Sample) „ *6 -*^2 .= 

(a) ni = 



(b) -12 - ns = 
(d) \z - -10 = 

-(dj vl2 - "10 = 



14. Fill in the blanks to hnf'dke true sentences. 



( (a), 
(b) 



(Sample) 

3 " 6 " 

4 ' 8 ■ 



= 



Ccl ■'9. .6 - ni.3 = , 

(d) M7. 1 - -79.3 = 



» • 
« 



9 



15; The ORpofl^te o'f *4 i6 '4 and the opposite of r4-i^ *4.. Thjp operation of 
' oppoaiting is 'syritten by a'minus^sign Thus, • ; 

. ^ / • .^/-''f =,M'/--4 = H knd — *4 = -"4 ='^^4' ^ ' 

Circle for *TI^^e^ *r for 'F^lse*', or * for *D6n't know^ ^or 
*C2Ln*t teir fo'r each^iof theifollowihg. sentences; * \ ^ 

. T , F.. ? <a) ■, :;3' = -3' * 

y T. F ? ■ {b)' --.7 + -*5 =^2 ^ ^ 

^- T F , ? ' (c)' -{-3 + -5^, 

■ ^ T - F ■? ^d) -(*r5 X -3> = -15'x *3 



'4. 




16. Circle the letter, of the'*e:xjpr"ession v/hich is most-U'ppropriale for filling in 
th^ blank. • ' , . • . • / *\ • \ • : V ' 
A B. C .p ^ (a) The sum^o^-^>ositiv'e 7 ,^and n^ative 3 iis / ^ 

A B G*^" D {i>) ^e'difference of negatiye 5 from negative, 3 rs ^ 



'{AT ^3-+ '5- (B).;:3--5' (C) -3 ;'- S. (D) -3-S, 
A ^ B - \c) The svtP^ of ne^^ttive 5 and ihe opposite of negative 7 



) (A)-|^'% .~"7' (B). ;5^+:7^^ CC)/5 -'■7.\' {t» r+'5 - ^7 • 

B D : (d) The difference of the opposite -6/ negative 4 froih 9 



IS 



« 'i(Aj-*9 -.'4. (B) 9 -'-4 .*tC) 9 - +"'4- (D^ 9 -,-'4 



» X ' , 



17? 1 FilJ in th^ blanks' to^akfe tTue pentenc-es. 
• ■ '-(Sample) -jn'stA tiT . 



(a) .*8 -r -2 
J[b}. :-12 -7*4- 
(c) -1-2 



-t 



'(d) vl 



= rz 



1^ 



0 



-.1 



, 18, Fill in the blanks\.to jnake^^ruo- sentences, 

-f/2,=^_2_ • 



(Sample) '6 



"IT — ^ 



■•(c) "^f^ 

(d) -^-i 



/ 



-V 



-5 



- 1 




10 
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f. 



■V 



1 SvT ' 



4? 



t 




11 



^0' 



19- 



Circl'e •^T*-for *True', for *False*„ or**?' for *D'on't^ow- or. 
'Ca[n*t teir for eacn of ^He following' sentences., (*<' tnearts *i"s les&^ than* : 
.and TT>eans *is greater than*. • , ' ; , 



(Examples) .fT) F ?^ 



%0 

"i) :^ 



^8 < n'l 




20. -Wll^h.of "the following- is true for each p^ir of numbers, _ ' • . . ' 

fA.) The first member o-f the pair is^g^e^ter than the 8<econd, •' . 
Si- (BVThe second member qf t^e'piir is greater tHan the firsf.^. • ^ 

•(C) Botlt^embe^-s al^e the. same. i 
' ' J(D) We ijiiioot tell -whether o'ne. ts greater 't^an or egual to ^Aie'oyier. 



(Example) /rA)-^ 'g : D; 



* 



A i B 



■ 

A . B 



9 






G 




t'. 


















d" 


J(c) 


C 







^' (3^2) 



- ) 







Th%/ iti *22L and other nupaerals.used^Jin the septenbeB .shown below ,affe \ 
from the planet Gldx, Wa know that each numeral nfces ^ number, but 
/ don't.krrow which number corresponds to any partic^^ nuinjj^c^J. <The % 
Vsigns/'>\ etc., have theirusual Earth meanings, ) ^ , - \ 



^Cti^le T' fox - True:, * F for * False';' or * ?^^for * Don't kixow' or ' - 

\ ' ' » * • * ' ^ 

' * Can't teirior each of the following sentences, v . ' ' , ' 

/ • » ' 

T" ;F ? (a)' U: &i > -is frue, ' ^ -is. - ' 

t f^" F '? Mb) If • -^.< V' • is true. ' > V ' M • " ' . 

/T' " .T . F ? (c) If --XZ >' El- 'hs tru'e, •.'50">-B- ; is 

V .-^ " T ,F • ? (a), I^•■^'=i&i^ • is.true, >"2^'is , '. 



^ 22. .Thc-absolute value of ^1 is wi'itten |*2|, and t^e absolute value 'of 'Z is 

^ 1**" .. * 

,.wrijtenj-2|/. ] ' . , ' 

* -21 = 2 and 1:24^ 2 



J 



{ 



Fili'in^the blanks as the s.ample shbws, . , • - 

. '^(Sample) , ' |^3 |^ f 3 -r- ' ^. / ■ ' _M \\ 



I* - • 



• ,2 



* * • 

' y - :^ 


•.'•i^ 






, . ■.• 



ERIC , 



- 1 



23i' Inthe^space at the right ojr'eachjine, list thef two nutnberjs which would 

■" ' - ■ ^ - ^ ■ 
correctly. complefta.the statement giyen. - ■ — 

(Sample) ' 7 +'.\ 



. ; " (a) |-9l = 36 

■ • ' . W ■ \^ i - l'9l =• 5 

- ' ^ . '• (<:).'• '51 = 10 





- ~r 24..; In ^acTi^ the. following Itentfences ,cixt:ie-the letter of the twcpre^^ion - 
^ • 'is most appropriate'^fof'fming^theh^^^ i£|^he ans.weiv caniiot be determined 
."^ . oj is not amorig the 'other choices given,, circle D. ' ' 



(A) a positive- nSri^ir^r^ i , 

(B) a negative nmnb^' , 

.(c) 0; ^- . ' *; i 

(D) ^fctinnot teir 




A B D ^R). The buin 5tsa negative n\imber and a ripgpositiye^ 



number is 



A * B C D * (b) - Th^ simn'of'-a negafive n\imbc;r arid a posiUve • 
' ♦ * ' ' 'n\amber iiB._ r* * • ' • . / 



B C .D ^ {c)^(The' sum of .0 and a honpositive tiuiAber Is 



^A^: ' B* G D ' (d) Suppose that two h^imbers are a'd^ed together, an4 a 
, • / ^ ^ \ third number is added to their Vum,. If th^ result is 

^' i * ,^ * , at least one of the three liufnbers is^ - , * 



I J 



2,5.^ Circle "^T' for *True\ ]r' for 'False-', or * for 'Don't know' or 



•Can't teir fax each of the following questions, 
Suppose that 



and 

Ifi It also tnie^that: 



*4. 




■*8 


= |(*4 + *8) = 


-5 


* 


:z 




1' 

"3 


* 


^7 


'^^i-CS +;-7) =• 



T 


F 




(») 






-F - 






■(*r. * ''4) *■ *2 '= •*! r4 * 




F 




^} 


*8' * 0 ='^ ,- . " 


T 




? 


(d) 


M *";4 = 0 ■ - • , 



1 



> ^ * ^ 



ERLC 



< 



/ 



each of the^ fpllowing open sentences, pu.t a in e^ch*r~J* andp * 



1. For 

in each 

If. the resulting sentence, is true, circle ' T\ 
ff, the resulting '^eritence' is false, c.irclfe * F\ ^ , 

^ the resulting ^entepce is neither true rioi-ialse,^xrclr* N\ 

. . (Example) @F N ]~] xQ'= "6 ^^^l^^^^ 







. T F 












* T" F 


N 


t" f. 


N 











e X .p -6) 



7 



' '.-1 

it * • . ' ' ' • . , * / * ^ ' ^ " • 

L.\\ He^re is'^^n* exafriple Df^.tablje of yalues Toj: the. -expression * 1 - /".^t^ 





•1 




1 — » ^' " 
0 


i 

' ?\ -'Ui ' 
e <■ 









Fpl in the blanks, in/the table of values ^bdlow.* 





'I ■ 


V 


• 

t 




. P 


"3. 


—t 

5 


. -6 ' 




• 






"4 






4 • 



4^ 



ERJC . ■ ■ • , 



Complete each sentence tp rnak^ it true/ writing jthe simplest expression/ 
you can in the blankV- - • ^ ^ ^i- - ; " 

, • < 

(Exarpple) *or each x,,the su^ of {x + ,^1) vand'^.(*3x^+ *4) is/%^_^^ 

(a) For ^g^h x,. the product of *5 by "3x is •' • ■ ; 

(b) For each x, the difference of ^7 from (x *7) is ' 

. i ' . • ■ • ' 

(c) For.e&ch x, for each y, {*3x f t^y) exceeds (^5x - *6y) by - 



(d) For e^ach x, for each y, for each z ^ 0, the quotient of .(•'''Sxz - *3y2) 
' by *3^2 is ' . ' . ^ • ' ^ ' " ' 



Complete eachj ^en^tence to, make it true, w*riting the simplest expression 
you can ip the blank. ' ' • ' - . 

.(Exalnple) 'l,^Fo.r each v/hoie num*ber >^of arithmefeic, if one pencil 
• * * costs«l*Z cents, x pencils cost t cents, 

(a) -^Foa: ekch whole number ^ of arithmetic, if on^ pencil coJsts ^3 cents, 

(x *5J pencil-s .co&t -Ir tents ' . - 

/ - ■• ^ . . . . ■ •- . 

(b) For ectch liui^ber ^ of arithmetic, if *3>tVrrrelons" a^e» fo be distributed 
equalj^y among "^5* ft^rspns, then each person should receive * , 



melons* 

(c) For each nonzero number' x'of arithmetic, a car traveling ata steady 
rate of '^'*3x *miles an hour v)tll travel *150''mlles in hours. 



(d) Hor each r 
' . -a^pile *\ : 



numbe-r x of arithmetic, if there are 75 she'ets of, paper in 
pile ^1 inoh thick then there ^re sheets of papeip in a 



pile .*2x inches thictc. . ' . \ ' ' 



6.*Simplify each 'of the following expressions: 



. (Example) ^ '2b + "3b =' "^.^-^ 



(b) *5p + (*2 - *7p) = 



(c) *2("7 - *3k) + *2k = . * 

(d) (*3 - *2j) - ;4("2 - j) = 



7, . Circle the letter of the exprt^ssion which,, if written in the blank, would give- 
you a true sentence. ^ . • ' . 

(Example) For each y/ y + *2y 



(A),y*2-y . (B) *2'* y • y ^(CJS ^Sy /( D) y • y y 

(a) For each x, for each y, *4x- *^2y - " . - 

(A) %xy '(B)/^8xy (C) ^2y r "4x (D) *8 > xy 

(b) For each x, ("3x + ^7) - (*3x - "7) = j . , . 



.(A). *6x '(B) 6^+ '14 '(.C) Om (D) *14 
(c) For ecCch y7(y " *l)(y - "1) = ; 



iA) ^y^+.n (B) yy ^"^y -f '1 (C^ yy - 'Zy - *1 ' , (D), yy - ^2y -f/l 



(d) Foijxieaoh x, for each y, (x - '2]i(y 4 *3) = 



(A)t^xy - *6 (B) xy - 'Zy + *3x - '6 (C) x + y + n (D) '}x - Vy,, 



f ^• 



4 



• — ' • * 

8. , Simplify el^l^of the followihgiexiiressibns : 

(Example) , *2 ^ (^J < . 



(a) . \\) 



(b) ^o.'s.^ -o.qr 



(6). 



.^4- 'Z ^2 -'2 

"8 • '3 - 2 
^3 .*5'. ~ - 



4- -2 



5im|>li£y each of 'the following 'expressions ; 



(b) 



(Example) *ldz- ^ = 



:3x 



provided z. 4- \ 



provided a + b #">0. 



.||||bvided z 0 



(c) *9x(y + z) - ^3u(v +'z) _ , 
^ • \ ^3(y + z) ^ 



*2 



5r 3 r 

T ^ 



'2r nSr^ 



pirovided* y 4 z # 0 



pr-ovided r ^'0' 
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Each of ^he statements below is a consequence of -one of the fbllawirvg '* 
principles for Teal numbers. /Circle the letter corresponding'to the 
pi^inciple of which thfe g^tat^ment is a <:onsequence. 

' »(A) Commutative principle for addition ^ 

(B) Commutative principle for multiplicatibn' . . 

(C) Associative primfciple fb.r addition ^ * 
|D) Associativev principle for multiplication _ 

(E) ipistributive principle for multiplication over addition ' 





( Example ) 


' ii) 


B 


C D 

« 


E 


For each x, ^ + *3 = /3 + x 

t 


A 


B C 


D 


Ei 


(a) 


For 


each 


X, (^3x)(x + :5) = (x + *5)(*3x) 


A 


.B C 


'd 


E 


(b) 


For 


each 


y, '*7 Hgy. + ^3) + '5 = {y + *3) + *7 + "B"'^ 


,A 


B • C 


D 


E 


(cV 


For 


each 


X, rZx + "l)(*3x + *7) . 
















e^ZxK^Sx + *7) + (-l)r3x + *7) , 


A 


B . C 


D 


9 

E . 


(d) 


For 


each 


y, (y'+ *4)(y + -3)(y + '1) 



. . ■ = (y + *4)[(y+-3)(y+'a)] 

Each of the statements below is a consequence of one of the following * 
principles for real numbers. Circle the letter corresponding to the 
principle of which the statement is a <:«onsequence, 

- (A) Principle for adding 0 

(B) Principle for multipl^ng by 0, ^. v ^' 

(C) Principle for multiplying by *1 ^ 

(D) Principle of oppo sites, or Introduction principle for oppo siting 

(E) Principle of quotients, or Introduction principle for division 

(F) Principle tor subtraction, or Definition principle for subtraction 

(Example) - A B (€) 'd , E F, "13 • *2 • V= '13 r *2 ' 



A 


B • 


C 


D 


.E 


F 


(a) 


(-3 + 0) + *7 = ■ 


3 + *7 


A 


B 


C 


D 




F 




*578 + -*578 = 




A 


B 


c' 


D 


E. 


F 


'(c) 


*7 + '2 = [(*7 + 


-2)-f-a]^3 ' 


A 


B 


C 


D 


B 


F 


' (d) 


(•-19 + *7) - *\5 


= ("19 + *7) + -n5 



19^ 



^ Here is a test pattern for a generalization, ^In each of the first five' step* 
one of the'^fbllowing principles for real n\inabers ^is used. The first is given 
as an exartfple. Circle the correct letter to indicate tti'e principle used in 
the next f Qux steps. , ' • . J ' 

(A) COnnnnutative principle for additiQn - 

(B) Cofnnn\itative principle for multiplication ' ^ - 
-(C) .Associative principle for addition 

(D) Associalive principle for multiplication - ^ 
(JE) Distributive princi^JiC^^fpr multiplication over addition 







B 


c 




E 


}--- 


A ■ 


B 


c 


D 


E 


}-- 


A 


B 


* i 

9 


D 


E 


}^-- 


A 


B 


c 


D 


E 




A 


B 


c 


D 


E 



(Example) 



. ♦ ■ 

• = .y *Z + {*3y + -^5) + 'S' 
= (y'*Z + "5 + "8 

= (*2y + *3y) +.*5 + '8 " 

' =' + (-"5-+ -8) 

(Below is a» proof of the theorem: ^ 

- For eaph* X, -y, and z, if z + x =.z + y ^then x = y. 

Fill in the blanks to complete the proof, using one of the following in each 
jlank: ' ♦ , ' 

{Proof] ' • ^ ^ ' ' ' ' 

(Example) • 

Suppose that /z •^ x = ]^ + y [Given statement] 1 

' / i . - ^ • , ^ 

Then, - z + x4;-z = z + y+ ' • ' ' 

, X z + -z = y'+' ^ + -z /[Commutative ^jrinciple^fOr 

, ' - ' ' . , * addition] 

X. + {z+^-z) - + (z + -z) [Associative principle for 

✓ " . * ^ . ' ' . / addition] 

/ \ X H;, 0 = y + . [Principle of opposites, or 

I 4 introduction principle for 

, - • * ' ^ ' \^ ^/ oppo&iting] 

So, V .X = y. ' * ' [Principle for addf<jng O] * / 

Hence, if z + x z t Y then 'x = y. ^ 



4 •• J' 



f 



14. Here are four incomplete lists of some of the ordered pairs of niimbers 
^ . which, belong to certain common operations.. Complete the lists by inserting 
th^ appropriate niamerals/ . * * . , ^ . 



(Example) fZ.H), (*-5/7), (m/lS), ClO.^Z) 

K ' ■ ■ I ■ 

t . > • » 

<a) (*2,H), (*3/6), ri8/36), (*21,*42), (^O, ) 

(b) r8,*6)/ (*T,M)M"3,-6), (0,-3),. J^r • / 

{c) (n2,*4), (n'5, -5h (0,0), (-21,-7), ( , *6) * 

(d) *(^2,*4), (-4,^^), (*5,*25), (n^0,nc(0), (-3,_^)' . •. 



15. Circle, the letter for the^ ordered pair of numbers which completes tl^je 
^ 7 ^ sentence to make it true.. 



\ 



' (ExamjJle) . A B (C/ D Addition of 2 contains ^ 



• . ^ (A) (3.6) (B) (5,3T ^ 

^ • (C) (7,9) (D). i^:^) 



0' 

A B * C D 



\ 



(a^ Multiplication by 2 contains 



.(A) (8,10) (B) (30,15)# (C) (0,0)^ {D^(5,3) 



^ A* B C D (b)** Division'by .5 contains 



(A) (8, L.6) (B) ^10/5) (G) (12,2.2) (D) ^(0, 5) 



A B C D (c) The inverse' of addition of 6 "contains 



(A) (6,1) (B)- (7,13) (C) (50,46,) (D.). (70, 64) 



d ' ' . ' 

A 'B C D (d) 'The inverse of multiplication by 7 contains^ 



ERIC 



(A) (14,^1) (B) (0,0) (C) (7,0) (D) (5,35). 



Pairs of xejil nxxmbers whose sum is 0 are dalled oppo sites , <ind each is* 
the opposite of the other. Circle the Uest answer, . 



0 ^ 'l^ none of the*s6 



(a) Wh^Et is the opposite of 0 ? 

(b) What is the opposite of '1 ? 

(c) Whatsis the opposite of ^0.25? ^4 '0.25. *0.25 " none of these 



*1 "1 npne of these^ 



(d) What is'*the opposite of -(-j)?* 



'(I) '(1) "(I) ^ -^one of thes^ 



pairs of ^eaLjiumbers whose jproduct is 



1 



called reciprocals , and each 



is the reciprocal of the other. .-'Circle tiie.bes|^ answer 
(a) What is the. reciprocal of ^? 



0^1 1 none of these 



(b) What'is the reciprocal of *1 ? * 



(c) What is th i^eciprocalof "0. 25 ? ''4 ''0.25 ^0..25 i* none\of these 



0 , ""1 ' ^ ^1 • none oi these 



\d) What i the -reciprocal of "(j)? *(|-)' !(f) .'^) 



.none of these 



18* On each line, circle the letter of the word which would make a ti5ue state- 
ment if put in the blank. If the correct word is not in the list/ circle, *(D)\ 

t (A) inverse , ' • ./ , ^ 

(»B) opposite • » 1, ' ) ' \ 

(C) ' r^cipro6al 



(D) none of the^e 
/B C D , (a) ""7 is the ^ 



of 



A B C D (b) ^0.5. is the ' ' \ of . \ 

/a B C D 'r(c) T^isthe^^ of ^S." ' , . ' 



A B ' C , D, (d) Subtraction of \4 is the ^ of addition of *4. 



19, 'On each line, circle the letter of the nxxmber which would make a t;ru.e statc?- 

ment if a^numeral for it. were put in the bl4nk» If t\e\correct number is not 

in the list, circle. *(D)\ , ^ 

(A) n ' — , . . ' / / 

^ (3) 0 ^ 

^ , (D) rlone of thee e ,* r f ' 

■■ ■ • 

A ' B C D (a) The resjalt of dividing any number by -0 is' 

' '\ • ■ ■ ■ ' 

* k}. , ■ ■', . • • < 

A ^B C D (b) The- of multiplying ciny numbly by ^y is the 

oppo^^j$^.--bf th^^'-puxrxber. . ' . 

A B C D {c)''The refciprocal of is 0. • . 

A B C D , (d) The opposite of the* reci4>rocal of j/ is 1.. 



Circle one correct answer for each question, 

(a) How many .real nivimbers satisfy the sentence *a 4- *5 = ^2' ? 

' , (A) none ' (Bj only 1 (C) only 2 (D) all . r 

*' • 

(b) How many real numbeijs satisfy the sentence *aa = 0',^ ' 
(A) none (B)* only.l ^C) only 2^ (D) all 

(c) How nian\y real ^numbers satisfy the sentence *bb = "1* ? 

(A) npne\ ' (^) only 1 , (C^ only. 2 (D) all 

• \ — ' ' > ' , • I * 

\ ^ . ^ ' 

(d) How many \real numbers satisfy the sentence'\(p - 3){p + 2) = 0*? 

^ (X) 'noire \ (B) only 1 (C) only 2 (D) all 

■ A ■ ■ 

\..-' .... 

• . -i ' ■ . . 

For eachdy the following sentences, circle 'T'^for *True\ *F' for * False', 
and ' ?,V for/ Can't Ijeir, * . • * * 



T ^ F ? (a) Sdme open sentences are true. 



'T# F ? (b) A raise sentence is ndt a stateroent. \ 
^ » * . . . • • 



1 



T F ? (c) The^^two.expressions/'^Sa + "^Za* and **3a' are equivatlent 
4 * expr;essions, . - ^ . ^ 



T F* ? 



(dV A counl^r- example to a universal generalisation shows 
that t^ie geaierali^tion is falae*. 



In order tp write generalizations concisely, we use the symbol *y'. . Write 
e^ach^Q^the generalizations below usfng *V' and oth^r algebraic symbols, ^ 



(Sample) No matter what real nvimber yo.\i pick^ its product 



(a) WJiateve^real number you choOse, if you subtract the number from 0, 
you ^et the opposite of 4:he number. 



(b) For^^ch real 'number, the result of adding its product by *'7 t'o its * 
pfoduct by ^3 is the same as its product ^by . ^ ^ 



4 



(Sample) No matter whgrt; nonzero real number you pick, the 
\ ' quotient of the number by itself is. ' * 



• » * 

(c) *?ick any real number different from ,"1, Add *1 to 'Double the , 
result a^d then ^divide 

* , Tl}e final result is ""2.. 



result a^d then^divide by the s\im of the number you picked and ''^'1 . 



(dj Ptok any real number* x. Now pick a, second real number y which is 
\ not the opposite of x. It will always turn out that 



f 



r 



, 13 ( 



23*. The open sentence * \ \ \ = *4'^ becomes a true statement if we put a 

•5^2* in place qf th^. * 1171' • other words, it is true that there exists ^a ^reai 
number such that the sum of it and ■*'2 is .For simplicity, we use the 

symbol * =J',to express the Sentence above, and write: ^ ^ , 

. ' * ^ ^ {x + *2) = ^ ^ 

X ^ ' 

Translate each of the following sentences into a sentence which uses a * 

• # * - * ^ • / 

and other algebraic symbols. * , ' 

(a) There is a real number such that the product of that number by "7 . 



(b) There exists a real number whose sum with itself is 0*\ 



Furthermore, we can^use both of the symbols * V and * 3' to write a concise 
statement of the generalization^that, for each first real number, there fs a 
second^real nurpber such that the product of /the first by itself is .the second. 
'Here is such a concise statement: ^ 

V 3 X* » = y 

X y . ^ ' * ^ 

Translate ^eaeh of the following sentences into 'a sentence which uses * V'^ 
*3', and'other algebraic symbols. 

(c) For. each first real namber, there is a se;cond re^l number such that 
, the sum of '7 and the second is the first. * 



(d) "There exists "a first real uumb'er such that, for each second real 
number^ "the s^um' of *6 and the second is the £irst. 



ERJC .• 



On. each linefcircle the letter of the ansf^^er whiclj' woi^cl njake a^true . 

statement if pUt in the blank. If answers- A, B,» and C would all make true 

istatexnents", circle If neither the A, B, or C answers would naakw^, 

true statements, circle *E'. , ^ ' * ^ ' ' 

' , *^ , • f 

(A) yyif.'x is positive then / ' yo - ' * 

/ ^ (B) V if X is negativeHhen , ' ' ' ^ / * - > 

(C) V if X ^t- 0 

(D) Aiiof these " ' . . 

^ * 

(E) None of these 



'(Example) A B' C 
A B C D cE (a) 
A B ,.C D E {hf 
'a b" c. -d E '-"(c)', 
ABC 



E 



(x + *1) * x is positive, 



3 E (d) \ 



-X IS negative, , ' 

X • X is ^sitiVe , \ 

x''-x IS nonp9sitive, , 

■ ■ . -1 ■ 

*(x'x) - (x -f **'l)' is honnegative. 



On each line circle the letter of the ctnswer whicli v^ould make the mofet 
general true statementipi^ji^sible 

(Example) A B IC D ' ^, 



X y 

A^ BCD (a) 

(A) ' V; V 

X y , 

ABC -D^"^ 

(A) V V V . 
. ' ' X y z ' 

A B D (c). 

(A) V V V 

X y z 

A ^ C D (d)- 



1(B) V .^^.VT 



_x + y= y + x 



(x - y)(x + y) = XX - ^^y^ 



^ ' ' X 0 y 



(C) V V 

X _ y =?' 0 ! i- 



^ -z(x + y) + -z(x - y) 1 - -*2bcz 



.(B> V V V ,o 
x y z ?!:0 



(C) V 



X gtO» y :jfeQ z 



X 



+ y = 





■\ " 


(Id) 








^zlcz- 












1 





X y z 



(B)"l V V ^^V 



z t xy 



1 1 

X y 



.1=1 



X 



xy . 



' (A) V V 
* • X y 



15' 



26. For each sentence, find a, real^iirtibej which satisfies" it. ' 





. 27. 



For each i^entence, fin4 all the real nvumbers which ** satisfy" it. fi 
there are nohe,. write *noneI. . ^ 



• (Exarpple) a = *16 * ' ^> 

(a) b(b - *2) = b ' 

'(b) c ' c + *4 = 0 

(c) d-dv'noo = 0 



r 



ERIC 



20^ 



1^ 



Below is a p2?oof/of the theorem:. ^ • • . • . / 

V xo = 0 r ' 

' ■ ' • ' ■■ ■ 

Fill in the blanks, to complete the prooJ^u^ing one of the iollowing in* each 
blank: " ^ * 



X, XX, xO, 0, ^{xx) 



(Proof) • * 

X + 0 = .X 

x(x + 0) ' ^ 

(x + 0)x = XX V 
) 

XX + Ox - XX ^ 

Y 

XX + xO = XX k 
XX + xO = XX ^ 

XX + xO + _^ 



[Principle for adding 0] 



[Uniqueness principle^^r rn^tiplicati^n] 

- - - fCorrrfnutative principle ior multiplication J 

[Distributive principle for multiplication 
over* addition] i — 

: ^ ^ ^ 

, [Commutativ^e principle for multiplicationj 



\ -.*/\ [Principle for adding' 0] 

' V - * ■ ' ^ .• ■ ' 

^ ' * y*., [yniquene ss principle'for addition] 
= XX + 0 + Hxx}^^ 

[Commutative principle for addition] 



xO + XX + -(xx) = 0 + XX + -(xx) ^ 
xO + [xx + -{x3^)] = 0 + [xx + -(xx)]^"' 
xO + = 0 C 0 



^^•-[Associative pitinciple for addition] 



[Principle of opposites or. 
' Introduction Principle for oppositing] 

— • [Principle for adding 1^ 



29- 



^Derive the following generaliz'atipn^^,; X. ^ , 



Ml 



17 




in your derivatioi\'use*^only thfe principles listed below: 

Comxjnutative principle fpr additioli [CP^]. 
Comnnutative principle for multiplicati^h [CPM]^ 
Associative principle for addition' [APA]»\ j"" ' * \ 

* Associative principle for multiplication [APM] 
.Distributive principle for'multipiicatio*n over addition [DPMAJ 




/ 



